2024-04-25T10:22:39.935 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T10:22:39.935 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/lockdep} --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075 -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/orig.config.yaml 2024-04-25T10:22:39.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:22:40.058 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/lockdep} email: pdonnell@redhat.com first_in_suite: false job_id: '7673075' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 valgrind: exit_on_first_error: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnfFU/FF+A2FgDaFtev8AlM5doMod2oZzT/AnVHnwh6irdWE0pyUdxPBIY9Ws1T4/dL0RdwiVuWNhnavBID5I8= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFq/PBymE06v6A11PyL/Sj2ZIQRTxhAUYCEJYpNgnPlG2BagAriIIrElLNeKy/E96PRn2wGq8lj6CrUvsi8ZjY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T10:22:40.059 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T10:22:40.060 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T10:22:40.060 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T10:22:40.061 INFO:teuthology.task.internal:Checking packages... 2024-04-25T10:22:40.087 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T10:22:40.087 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T10:22:40.087 INFO:teuthology.packaging:ref: None 2024-04-25T10:22:40.087 INFO:teuthology.packaging:tag: None 2024-04-25T10:22:40.087 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:22:40.088 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:22:40.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:22:40.233 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:22:40.234 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T10:22:40.241 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T10:22:40.242 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T10:22:40.293 INFO:teuthology.task.internal:Saving configuration 2024-04-25T10:22:40.309 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T10:22:40.328 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T10:22:40.390 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:16:54.850212', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDq3t6mOwtomaTBOfjk8KIbX1PfnpGR4uYiTexCnTNDH'} 2024-04-25T10:22:40.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 10:16:54.851268', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOb1Kjtv0T9mJss88JIlSlwV0yaVQ449miKTK2/1Qpf2'} 2024-04-25T10:22:40.411 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T10:22:40.417 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T10:22:40.417 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T10:22:40.417 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T10:22:40.480 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa8cc8303a0>, signals=[15]) 2024-04-25T10:22:40.481 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T10:22:40.487 INFO:teuthology.task.internal:Opening connections... 2024-04-25T10:22:40.487 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:22:40.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:22:40.576 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:22:40.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:22:40.656 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T10:22:40.662 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-25T10:22:40.668 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-25T10:22:40.668 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-25T10:22:40.714 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T10:22:40.714 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2024-04-25T10:22:40.714 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2024-04-25T10:22:40.714 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T10:22:40.714 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T10:22:40.715 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2024-04-25T10:22:40.715 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-25T10:22:40.740 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-04-25T10:22:40.746 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-04-25T10:22:40.746 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="22.04" 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=jammy 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2024-04-25T10:22:40.792 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2024-04-25T10:22:40.793 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T10:22:40.793 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T10:22:40.793 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T10:22:40.793 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T10:22:40.793 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=jammy 2024-04-25T10:22:40.793 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-04-25T10:22:40.815 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T10:22:40.824 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T10:22:40.846 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T10:22:40.846 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:22:40.848 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-04-25T10:22:40.853 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T10:22:40.892 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T10:22:40.892 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:22:40.895 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-04-25T10:22:40.918 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T10:22:40.972 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T10:22:41.006 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T10:22:41.006 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-25T10:22:41.007 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-25T10:22:41.007 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:22:41.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:22:41.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T10:22:41.277 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:22:41.277 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T10:22:41.278 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-25T10:22:41.283 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2024-04-25T10:22:41.283 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:22:41.284 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T10:22:41.284 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T10:22:41.284 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T10:22:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T10:22:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T10:22:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T10:22:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T10:22:41.482 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git config --global init.defaultBranch 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git branch -m 2024-04-25T10:22:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T10:22:41.486 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T10:22:41.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T10:22:41.612 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T10:24:15.783 INFO:teuthology.orchestra.run.smithi016.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T10:24:15.784 INFO:teuthology.orchestra.run.smithi016.stderr: * [new branch] main -> origin/main 2024-04-25T10:24:15.818 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T10:24:15.819 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T10:24:15.821 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T10:24:15.821 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T10:24:15.821 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T10:24:15.821 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T10:24:15.822 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T10:24:15.823 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T10:24:15.825 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T10:24:15.825 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T10:24:15.825 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T10:24:15.825 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T10:24:15.826 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T10:24:15.827 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T10:24:20.339 INFO:teuthology.orchestra.run.smithi016.stderr:Updating files: 44% (1497/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 58% (1978/3381) Updating files: 59% (1995/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 68% (2330/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 82% (2781/3381) Updating files: 83% (2807/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T10:24:20.345 INFO:teuthology.orchestra.run.smithi016.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T10:24:20.368 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T10:24:20.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T10:24:20.606 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T10:24:20.606 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T10:24:20.609 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-25T10:24:22.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25 10:24:23 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T10:24:22.535 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2024-04-25 10:24:23-- 2024-04-25T10:24:22.535 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 1.9s 2024-04-25T10:24:22.535 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 43M in 1.7s (25.6 MB/s) 2024-04-25T10:24:22.539 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T10:24:22.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T10:24:22.808 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T10:24:24.855 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T10:24:24.861 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T10:24:25.002 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T10:24:28.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T10:24:28.984 INFO:teuthology.orchestra.run.smithi016.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:52.575 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-25T10:24:52.589 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T10:24:52.604 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-25T10:24:52.948 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:52.965 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:53.247 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T10:24:53.256 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T10:24:53.316 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T10:24:53.321 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T10:24:53.488 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T10:24:53.488 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T10:24:53.488 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T10:24:53.529 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-25T10:24:53.702 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T10:24:53.709 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T10:24:53.709 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T10:24:53.710 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:53.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:53.724 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:53.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T10:24:53.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T10:24:53.744 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T10:24:53.745 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T10:24:53.746 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T10:24:53.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T10:24:53.748 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T10:24:53.749 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T10:24:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T10:24:53.751 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T10:24:53.767 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T10:24:53.767 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T10:24:53.767 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T10:24:53.767 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T10:24:53.768 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T10:24:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T10:24:53.770 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T10:24:53.771 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T10:24:53.772 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T10:24:53.773 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T10:24:53.774 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T10:24:53.775 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T10:24:53.776 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T10:24:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T10:24:53.778 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T10:24:53.778 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T10:24:53.778 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T10:24:53.844 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T10:24:53.844 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T10:24:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T10:24:53.846 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T10:24:53.847 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T10:24:53.848 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T10:24:53.849 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T10:24:53.850 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T10:24:53.851 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T10:24:53.852 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T10:24:53.853 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T10:24:53.854 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T10:24:53.855 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T10:24:53.856 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T10:24:53.857 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T10:24:53.858 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T10:24:53.859 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T10:24:53.860 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T10:24:53.861 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T10:24:53.862 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T10:24:53.863 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T10:24:53.864 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T10:24:53.865 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T10:24:53.866 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T10:24:53.867 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T10:24:53.868 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T10:24:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T10:24:53.870 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T10:24:53.871 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T10:24:53.872 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T10:24:53.873 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T10:24:53.874 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T10:24:53.875 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T10:24:53.876 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T10:24:53.877 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T10:24:53.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T10:24:53.879 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T10:24:53.880 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T10:24:53.881 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T10:24:53.882 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T10:24:53.883 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T10:24:53.884 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T10:24:53.885 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T10:24:53.886 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T10:24:53.887 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T10:24:53.888 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T10:24:53.889 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T10:24:53.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T10:24:53.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T10:24:53.892 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T10:24:53.893 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T10:24:53.894 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T10:24:53.895 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T10:24:53.964 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T10:24:53.964 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T10:24:53.964 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T10:24:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T10:24:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T10:24:53.967 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T10:24:53.968 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T10:24:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T10:24:53.970 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T10:24:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T10:24:53.972 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T10:24:53.973 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T10:24:53.974 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T10:24:53.975 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T10:24:53.976 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T10:24:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T10:24:53.978 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T10:24:53.979 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T10:24:53.980 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T10:24:53.981 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T10:24:53.982 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T10:24:53.983 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T10:24:53.984 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T10:24:53.985 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T10:24:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T10:24:53.987 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T10:24:53.988 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T10:24:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T10:24:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T10:24:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T10:24:53.993 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T10:24:53.994 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T10:24:53.995 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T10:24:53.996 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T10:24:53.997 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T10:24:53.998 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T10:24:53.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T10:24:54.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T10:24:54.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T10:24:54.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T10:24:54.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T10:24:54.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T10:24:54.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T10:24:54.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T10:24:54.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T10:24:54.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T10:24:54.009 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T10:24:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T10:24:54.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T10:24:54.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T10:24:54.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T10:24:54.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T10:24:54.015 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T10:24:54.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T10:24:54.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T10:24:54.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T10:24:54.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T10:24:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T10:24:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T10:24:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T10:24:54.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T10:24:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T10:24:54.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T10:24:54.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T10:24:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T10:24:54.069 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T10:24:54.070 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T10:24:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T10:24:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T10:24:54.073 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T10:24:54.074 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T10:24:54.075 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T10:24:54.076 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T10:24:54.077 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T10:24:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T10:24:54.079 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T10:24:54.080 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T10:24:54.081 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T10:24:54.082 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T10:24:54.083 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T10:24:54.084 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T10:24:54.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T10:24:54.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T10:24:54.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T10:24:54.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T10:24:54.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T10:24:54.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T10:24:54.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T10:24:54.092 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T10:24:54.093 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T10:24:54.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T10:24:54.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T10:24:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T10:24:54.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T10:24:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T10:24:54.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T10:24:54.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T10:24:54.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T10:24:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T10:24:54.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T10:24:54.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T10:24:54.105 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T10:24:54.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T10:24:54.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T10:24:54.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T10:24:54.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T10:24:54.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T10:24:54.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T10:24:54.112 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T10:24:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T10:24:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T10:24:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T10:24:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T10:24:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T10:24:54.117 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:54.118 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:54.118 DEBUG:teuthology.orchestra.run.smithi016:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T10:24:54.124 INFO:teuthology.orchestra.run.smithi016.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T10:24:54.124 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T10:24:54.124 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T10:24:54.125 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T10:24:54.125 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:54.125 DEBUG:teuthology.orchestra.run.smithi016:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T10:24:54.170 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi016.front.sepia.ceph.com to complete... 2024-04-25T10:24:54.673 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2024-04-25T10:24:54.674 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T10:24:54.685 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-25T10:24:54.848 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:54.854 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T10:24:55.135 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T10:24:55.140 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T10:24:55.184 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T10:24:55.190 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T10:24:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T10:24:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T10:24:55.354 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T10:24:55.365 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-25T10:25:26.475 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T10:25:26.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:25:26.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:26:01.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-25T10:26:10.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:26:10.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:26:28.514 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-25T10:26:40.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:26:40.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:26:43.586 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-25T10:26:58.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:26:58.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:26:58.876 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-25T10:26:59.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:26:59.475 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T10:26:59.476 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-25T10:26:59.527 INFO:teuthology.orchestra.run.smithi016.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T10:26:59.527 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T10:26:59.527 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T10:26:59.527 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T10:27:00.530 DEBUG:teuthology.parallel:result is None 2024-04-25T10:27:00.531 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T10:27:00.539 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T10:27:00.539 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:27:00.542 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T10:27:00.548 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T10:27:00.554 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T10:27:00.560 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T10:27:00.561 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:27:00.595 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T10:27:00.661 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T10:27:00.668 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T10:27:00.668 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T10:27:00.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:27:00.673 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:27:00.676 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T10:27:00.741 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:00.752 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:00.761 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:00.773 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T10:27:00.775 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T10:27:00.782 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T10:27:00.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:27:00.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T10:27:00.829 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T10:27:00.838 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T10:27:00.839 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:27:00.854 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T10:27:00.877 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:00.912 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:00.965 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:27:00.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:27:01.047 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T10:27:01.053 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T10:27:01.102 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:27:01.102 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T10:27:01.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-25T10:27:01.170 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-04-25T10:27:01.277 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T10:27:01.284 INFO:teuthology.task.internal:Starting timer... 2024-04-25T10:27:01.284 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T10:27:01.300 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T10:27:01.308 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2024-04-25T10:27:01.308 DEBUG:teuthology.task.selinux:Excluding smithi186: OS 'ubuntu' does not support SELinux 2024-04-25T10:27:01.308 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T10:27:01.308 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T10:27:01.308 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T10:27:01.309 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T10:27:01.317 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T10:27:01.322 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T10:27:01.450 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T10:27:01.466 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T10:27:01.468 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T10:34:43.054 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-04-25T10:34:43.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:34:43.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:34:43.137 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-25T10:34:43.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-25T10:34:43.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T10:34:43.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T10:34:43.333 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-25T10:34:43.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T10:34:43.447 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T10:34:43.471 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T10:34:43.472 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:34:43.472 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:34:43.475 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T10:34:43.475 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:34:43.511 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T10:34:43.511 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Command line: ntpd -gq 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: ---------------------------------------------------- 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: corporation. Support and training for ntp-4 are 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: available at https://www.nwtime.org/support 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: ---------------------------------------------------- 2024-04-25T10:34:43.512 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: proto: precision = 0.045 usec (-24) 2024-04-25T10:34:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: basedate set to 2022-02-04 2024-04-25T10:34:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: gps base set to 2022-02-06 (week 2196) 2024-04-25T10:34:43.513 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T10:34:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T10:34:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T10:34:43.514 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Command line: ntpd -gq 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: ---------------------------------------------------- 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: corporation. Support and training for ntp-4 are 2024-04-25T10:34:43.515 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: available at https://www.nwtime.org/support 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: ---------------------------------------------------- 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: proto: precision = 0.060 usec (-24) 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: basedate set to 2022-02-04 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: gps base set to 2022-02-06 (week 2196) 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi186.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T10:34:43.516 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen normally on 3 ens1f0 172.21.15.16:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen normally on 4 lo [::1]:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:43 ntpd[17121]: Listening on routing socket on fd #22 for interface updates 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T10:34:43.517 INFO:teuthology.orchestra.run.smithi186.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T10:34:43.518 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T10:34:43.518 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T10:34:43.518 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T10:34:43.519 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen normally on 3 enp3s0f1 172.21.15.186:123 2024-04-25T10:34:43.519 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen normally on 4 lo [::1]:123 2024-04-25T10:34:43.519 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df5%5]:123 2024-04-25T10:34:43.519 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:43 ntpd[17642]: Listening on routing socket on fd #22 for interface updates 2024-04-25T10:34:44.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:44 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:44.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:44 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:45.512 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:45.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:45 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:45.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:45 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:46.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:46 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:47.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:47 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:47.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:47.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:47.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:47.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:47 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:48.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:48.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:48.514 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:48 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:49.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:49 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:49.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:49.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:49 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:50.515 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:50.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:50 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.513 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:51.514 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:51.515 INFO:teuthology.orchestra.run.smithi016.stdout:25 Apr 10:34:51 ntpd[17121]: ntpd: time slew -0.000326 s 2024-04-25T10:34:51.515 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.000326s 2024-04-25T10:34:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T10:34:51.515 INFO:teuthology.orchestra.run.smithi016.stderr:25 Apr 10:34:51 ntpd[17121]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:34:51.516 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:34:51.517 INFO:teuthology.orchestra.run.smithi186.stdout:25 Apr 10:34:51 ntpd[17642]: ntpd: time slew -0.001504 s 2024-04-25T10:34:51.517 INFO:teuthology.orchestra.run.smithi186.stdout:ntpd: time slew -0.001504s 2024-04-25T10:34:51.517 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T10:34:51.517 INFO:teuthology.orchestra.run.smithi186.stderr:25 Apr 10:34:51 ntpd[17642]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================== 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.597 INFO:teuthology.orchestra.run.smithi186.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.619 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:34:51.620 INFO:teuthology.run_tasks:Running task install... 2024-04-25T10:34:51.629 DEBUG:teuthology.task.install:project ceph 2024-04-25T10:34:51.629 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T10:34:51.629 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T10:34:51.629 INFO:teuthology.task.install:Using flavor: default 2024-04-25T10:34:51.635 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T10:34:51.635 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T10:34:51.636 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2024-04-25T10:34:51.636 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-key list | grep Ceph 2024-04-25T10:34:51.704 INFO:teuthology.orchestra.run.smithi186.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T10:34:51.733 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T10:34:51.734 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T10:34:51.735 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T10:34:51.735 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T10:34:51.735 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:34:51.769 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T10:34:51.821 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T10:34:51.821 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T10:34:51.822 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T10:34:51.822 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T10:34:51.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:34:51.969 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T10:34:51.969 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:34:52.061 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T10:34:52.061 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:34:52.292 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:34:52.292 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T10:34:52.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2024-04-25T10:34:52.385 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:34:52.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T10:34:52.399 DEBUG:teuthology.orchestra.run.smithi186:> sudo apt-get update 2024-04-25T10:34:52.576 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T10:34:52.591 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T10:34:52.615 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T10:34:52.623 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T10:34:52.642 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T10:34:52.684 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T10:34:52.694 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T10:34:52.728 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T10:34:52.794 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T10:34:52.859 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T10:34:52.878 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T10:34:52.922 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T10:34:52.967 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T10:34:52.995 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T10:34:53.047 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T10:34:53.066 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T10:34:53.186 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T10:34:53.303 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T10:34:53.399 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 140 kB in 1s (174 kB/s) 2024-04-25T10:34:53.414 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 258 kB in 1s (295 kB/s) 2024-04-25T10:34:54.358 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2024-04-25T10:34:54.374 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:34:54.436 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2024-04-25T10:34:54.439 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-25T10:34:54.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:34:54.531 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-25T10:34:54.645 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2024-04-25T10:34:54.646 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2024-04-25T10:34:54.708 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-25T10:34:54.709 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-25T10:34:54.836 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:34:54.836 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:34:54.836 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout: python2.7-minimal 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2024-04-25T10:34:54.837 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T10:34:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T10:34:54.840 INFO:teuthology.orchestra.run.smithi186.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout:Recommended packages: 2024-04-25T10:34:54.841 INFO:teuthology.orchestra.run.smithi186.stdout: btrfs-tools 2024-04-25T10:34:54.888 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:34:54.888 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:34:54.888 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:34:54.888 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:34:54.889 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:34:54.889 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:34:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:34:54.889 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-25T10:34:54.889 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T10:34:54.891 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T10:34:54.892 INFO:teuthology.orchestra.run.smithi016.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2024-04-25T10:34:54.893 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T10:34:54.947 INFO:teuthology.orchestra.run.smithi186.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:34:54.948 INFO:teuthology.orchestra.run.smithi186.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T10:34:54.949 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T10:34:54.950 INFO:teuthology.orchestra.run.smithi186.stdout: socat unzip xmlstarlet zip 2024-04-25T10:34:55.049 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-25T10:34:55.049 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T10:34:55.049 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T10:34:55.049 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T10:34:55.049 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T10:34:55.051 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T10:34:55.052 INFO:teuthology.orchestra.run.smithi016.stdout: socat unzip xmlstarlet zip 2024-04-25T10:34:55.135 INFO:teuthology.orchestra.run.smithi186.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T10:34:55.135 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 175 MB of archives. 2024-04-25T10:34:55.135 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T10:34:55.135 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T10:34:55.218 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T10:34:55.249 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T10:34:55.249 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 175 MB of archives. 2024-04-25T10:34:55.249 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T10:34:55.249 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T10:34:55.263 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T10:34:55.296 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T10:34:55.332 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T10:34:55.378 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T10:34:55.445 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T10:34:55.465 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T10:34:55.560 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T10:34:55.574 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T10:34:55.576 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T10:34:55.626 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T10:34:55.671 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T10:34:55.684 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T10:34:55.740 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T10:34:55.800 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T10:34:55.809 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T10:34:55.837 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T10:34:55.845 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T10:34:55.915 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T10:34:55.924 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T10:34:55.952 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T10:34:55.961 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T10:34:56.010 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T10:34:56.129 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T10:34:56.584 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T10:34:56.600 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T10:34:56.616 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T10:34:56.629 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T10:34:56.630 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T10:34:56.647 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T10:34:56.678 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T10:34:56.691 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T10:34:56.695 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T10:34:56.696 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T10:34:56.714 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T10:34:56.730 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T10:34:56.751 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T10:34:56.765 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T10:34:56.765 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T10:34:56.782 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T10:34:56.809 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T10:34:56.823 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T10:34:56.827 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T10:34:56.827 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T10:34:56.849 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T10:34:56.867 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T10:34:56.953 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T10:34:56.960 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T10:34:56.998 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T10:34:57.035 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T10:34:57.061 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T10:34:57.078 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T10:34:57.081 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T10:34:57.094 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T10:34:57.100 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T10:34:57.169 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T10:34:57.202 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T10:34:57.221 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T10:34:57.248 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T10:34:57.283 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T10:34:57.299 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T10:34:57.306 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T10:34:57.312 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T10:34:57.419 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T10:34:57.437 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T10:34:57.443 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T10:34:57.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T10:34:57.498 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T10:34:57.586 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T10:34:57.599 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T10:34:57.627 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T10:34:57.633 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T10:34:57.654 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T10:34:57.717 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T10:34:57.732 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T10:34:57.778 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T10:34:57.789 INFO:teuthology.orchestra.run.smithi186.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T10:34:57.811 INFO:teuthology.orchestra.run.smithi186.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T10:34:57.812 INFO:teuthology.orchestra.run.smithi186.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T10:34:57.824 INFO:teuthology.orchestra.run.smithi186.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T10:34:57.836 INFO:teuthology.orchestra.run.smithi186.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T10:34:57.860 INFO:teuthology.orchestra.run.smithi186.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T10:34:57.865 INFO:teuthology.orchestra.run.smithi186.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T10:34:57.919 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T10:34:57.928 INFO:teuthology.orchestra.run.smithi186.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T10:34:57.970 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T10:34:57.982 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T10:34:57.998 INFO:teuthology.orchestra.run.smithi186.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T10:34:57.999 INFO:teuthology.orchestra.run.smithi186.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T10:34:58.004 INFO:teuthology.orchestra.run.smithi186.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T10:34:58.009 INFO:teuthology.orchestra.run.smithi186.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T10:34:58.023 INFO:teuthology.orchestra.run.smithi186.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T10:34:58.155 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T10:34:58.156 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T10:34:58.162 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T10:34:58.166 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T10:34:58.182 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T10:34:58.209 INFO:teuthology.orchestra.run.smithi186.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T10:34:58.377 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T10:34:58.474 INFO:teuthology.orchestra.run.smithi186.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T10:34:58.590 INFO:teuthology.orchestra.run.smithi186.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T10:34:58.637 INFO:teuthology.orchestra.run.smithi186.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T10:34:58.646 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T10:34:58.721 INFO:teuthology.orchestra.run.smithi186.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T10:34:58.733 INFO:teuthology.orchestra.run.smithi186.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T10:34:58.755 INFO:teuthology.orchestra.run.smithi186.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T10:34:58.788 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T10:34:58.801 INFO:teuthology.orchestra.run.smithi186.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T10:34:58.831 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T10:34:58.910 INFO:teuthology.orchestra.run.smithi186.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T10:34:58.912 INFO:teuthology.orchestra.run.smithi186.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T10:34:58.935 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T10:34:58.949 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T10:34:58.967 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T10:34:58.983 INFO:teuthology.orchestra.run.smithi186.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T10:34:59.022 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T10:34:59.141 INFO:teuthology.orchestra.run.smithi186.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T10:34:59.143 INFO:teuthology.orchestra.run.smithi186.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T10:34:59.147 INFO:teuthology.orchestra.run.smithi186.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T10:34:59.311 INFO:teuthology.orchestra.run.smithi186.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T10:34:59.347 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T10:34:59.409 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T10:34:59.410 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T10:34:59.412 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T10:34:59.577 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T10:34:59.649 INFO:teuthology.orchestra.run.smithi186.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T10:34:59.688 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T10:34:59.880 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T10:34:59.881 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T10:34:59.924 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T10:34:59.967 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T10:34:59.970 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T10:35:00.050 INFO:teuthology.orchestra.run.smithi186.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T10:35:00.059 INFO:teuthology.orchestra.run.smithi186.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T10:35:00.060 INFO:teuthology.orchestra.run.smithi186.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T10:35:00.129 INFO:teuthology.orchestra.run.smithi186.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T10:35:00.130 INFO:teuthology.orchestra.run.smithi186.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T10:35:00.131 INFO:teuthology.orchestra.run.smithi186.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T10:35:00.133 INFO:teuthology.orchestra.run.smithi186.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T10:35:00.133 INFO:teuthology.orchestra.run.smithi186.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T10:35:00.135 INFO:teuthology.orchestra.run.smithi186.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T10:35:00.155 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T10:35:00.307 INFO:teuthology.orchestra.run.smithi186.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T10:35:00.358 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T10:35:00.367 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T10:35:00.373 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T10:35:00.444 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T10:35:00.445 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T10:35:00.446 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T10:35:00.446 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T10:35:00.447 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T10:35:00.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T10:35:00.508 INFO:teuthology.orchestra.run.smithi186.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T10:35:00.613 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T10:35:00.824 INFO:teuthology.orchestra.run.smithi186.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T10:35:00.827 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T10:35:00.860 INFO:teuthology.orchestra.run.smithi186.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T10:35:00.890 INFO:teuthology.orchestra.run.smithi186.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T10:35:00.901 INFO:teuthology.orchestra.run.smithi186.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T10:35:00.924 INFO:teuthology.orchestra.run.smithi186.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T10:35:00.947 INFO:teuthology.orchestra.run.smithi186.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T10:35:00.958 INFO:teuthology.orchestra.run.smithi186.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T10:35:00.963 INFO:teuthology.orchestra.run.smithi186.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T10:35:00.967 INFO:teuthology.orchestra.run.smithi186.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T10:35:00.969 INFO:teuthology.orchestra.run.smithi186.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T10:35:01.029 INFO:teuthology.orchestra.run.smithi186.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T10:35:01.050 INFO:teuthology.orchestra.run.smithi186.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T10:35:01.059 INFO:teuthology.orchestra.run.smithi186.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T10:35:01.109 INFO:teuthology.orchestra.run.smithi186.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T10:35:01.154 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T10:35:01.170 INFO:teuthology.orchestra.run.smithi186.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T10:35:01.202 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T10:35:01.228 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T10:35:01.237 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T10:35:01.284 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T10:35:01.310 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T10:35:01.312 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T10:35:01.319 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T10:35:01.321 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T10:35:01.434 INFO:teuthology.orchestra.run.smithi186.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T10:35:01.457 INFO:teuthology.orchestra.run.smithi186.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T10:35:01.518 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T10:35:01.678 INFO:teuthology.orchestra.run.smithi186.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T10:35:01.681 INFO:teuthology.orchestra.run.smithi186.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T10:35:01.698 INFO:teuthology.orchestra.run.smithi186.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T10:35:01.704 INFO:teuthology.orchestra.run.smithi186.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T10:35:01.741 INFO:teuthology.orchestra.run.smithi186.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T10:35:01.759 INFO:teuthology.orchestra.run.smithi186.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T10:35:01.771 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T10:35:01.862 INFO:teuthology.orchestra.run.smithi186.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T10:35:01.865 INFO:teuthology.orchestra.run.smithi186.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T10:35:01.866 INFO:teuthology.orchestra.run.smithi186.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T10:35:02.039 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T10:35:02.041 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T10:35:02.052 INFO:teuthology.orchestra.run.smithi186.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T10:35:02.057 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T10:35:02.063 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T10:35:02.103 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T10:35:02.117 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T10:35:02.208 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T10:35:02.210 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T10:35:02.211 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T10:35:02.318 INFO:teuthology.orchestra.run.smithi186.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T10:35:02.601 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T10:35:02.727 INFO:teuthology.orchestra.run.smithi186.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T10:35:02.727 INFO:teuthology.orchestra.run.smithi186.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T10:35:02.744 INFO:teuthology.orchestra.run.smithi186.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T10:35:02.797 INFO:teuthology.orchestra.run.smithi186.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T10:35:02.834 INFO:teuthology.orchestra.run.smithi186.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T10:35:02.843 INFO:teuthology.orchestra.run.smithi186.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T10:35:02.865 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T10:35:02.967 INFO:teuthology.orchestra.run.smithi186.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T10:35:03.422 INFO:teuthology.orchestra.run.smithi186.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T10:35:03.422 INFO:teuthology.orchestra.run.smithi186.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T10:35:03.832 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T10:35:03.876 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T10:35:04.110 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T10:35:05.903 INFO:teuthology.orchestra.run.smithi186.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T10:35:05.905 INFO:teuthology.orchestra.run.smithi186.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T10:35:05.910 INFO:teuthology.orchestra.run.smithi186.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T10:35:05.911 INFO:teuthology.orchestra.run.smithi186.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T10:35:05.912 INFO:teuthology.orchestra.run.smithi186.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T10:35:05.913 INFO:teuthology.orchestra.run.smithi186.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T10:35:06.427 INFO:teuthology.orchestra.run.smithi186.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T10:35:07.055 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 175 MB in 11s (15.2 MB/s) 2024-04-25T10:35:07.199 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T10:35:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-04-25T10:35:07.287 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T10:35:07.339 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T10:35:07.617 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T10:35:07.637 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T10:35:07.675 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:35:08.003 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T10:35:08.023 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T10:35:08.069 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T10:35:08.530 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T10:35:08.551 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T10:35:08.647 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:35:09.018 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T10:35:09.038 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T10:35:09.076 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:35:09.504 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T10:35:09.524 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T10:35:09.571 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:35:10.073 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T10:35:10.132 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T10:35:10.153 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:10.232 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:10.661 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T10:35:10.681 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:10.718 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:10.832 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T10:35:10.855 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T10:35:10.898 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T10:35:11.082 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T10:35:11.130 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T10:35:11.151 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:11.197 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:11.608 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T10:35:11.629 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T10:35:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:35:11.874 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T10:35:12.294 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librados2. 2024-04-25T10:35:12.315 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:12.353 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:12.906 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librbd1. 2024-04-25T10:35:12.926 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:12.972 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:13.500 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T10:35:13.520 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:13.566 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:13.697 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T10:35:13.697 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T10:35:13.757 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T10:35:13.877 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T10:35:13.910 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rados. 2024-04-25T10:35:13.922 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T10:35:13.923 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:13.937 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T10:35:13.969 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:14.054 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T10:35:14.314 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T10:35:14.334 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:14.380 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:14.489 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T10:35:14.489 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T10:35:14.682 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T10:35:14.703 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:14.749 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:15.127 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T10:35:15.148 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:15.193 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:15.564 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T10:35:15.584 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T10:35:15.613 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T10:35:15.858 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T10:35:15.878 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:15.916 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:16.269 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T10:35:16.289 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T10:35:16.327 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:35:16.393 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T10:35:16.394 INFO:teuthology.orchestra.run.smithi016.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T10:35:16.396 INFO:teuthology.orchestra.run.smithi016.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T10:35:16.396 INFO:teuthology.orchestra.run.smithi016.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T10:35:16.397 INFO:teuthology.orchestra.run.smithi016.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T10:35:16.397 INFO:teuthology.orchestra.run.smithi016.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T10:35:16.621 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T10:35:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T10:35:16.679 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:35:16.974 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T10:35:16.994 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T10:35:17.032 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:35:17.049 INFO:teuthology.orchestra.run.smithi016.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T10:35:17.552 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package lua5.1. 2024-04-25T10:35:17.572 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T10:35:17.610 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:35:17.711 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 175 MB in 22s (7,951 kB/s) 2024-04-25T10:35:17.888 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package lua-any. 2024-04-25T10:35:17.894 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T10:35:17.909 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T10:35:17.938 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T10:35:17.988 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T10:35:17.988 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T10:35:18.018 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T10:35:18.166 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package zip. 2024-04-25T10:35:18.177 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T10:35:18.216 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T10:35:18.404 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T10:35:18.418 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T10:35:18.496 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:35:18.536 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package unzip. 2024-04-25T10:35:18.556 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T10:35:18.594 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:35:18.807 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T10:35:18.822 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T10:35:18.865 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T10:35:18.973 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package luarocks. 2024-04-25T10:35:18.993 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T10:35:19.031 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:35:19.335 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T10:35:19.351 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T10:35:19.397 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librgw2. 2024-04-25T10:35:19.418 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:19.435 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:35:19.455 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:19.706 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T10:35:19.721 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T10:35:19.755 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:35:20.066 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T10:35:20.078 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:20.092 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T10:35:20.108 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T10:35:20.116 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:20.150 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:35:20.444 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T10:35:20.464 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T10:35:20.502 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:35:20.596 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T10:35:20.611 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:20.663 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:20.838 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T10:35:20.859 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:20.896 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:20.982 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T10:35:20.998 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:21.032 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:21.275 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-common. 2024-04-25T10:35:21.295 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:21.324 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:21.410 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T10:35:21.426 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:35:21.468 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:35:21.822 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T10:35:21.837 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T10:35:21.880 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:35:22.150 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2024-04-25T10:35:22.165 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:22.200 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:22.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2024-04-25T10:35:22.851 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:22.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:22.913 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-base. 2024-04-25T10:35:22.934 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:22.980 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:23.289 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T10:35:23.303 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:23.347 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:23.526 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T10:35:23.538 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T10:35:23.567 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:35:23.625 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2024-04-25T10:35:23.640 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:23.683 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:23.853 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T10:35:23.874 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T10:35:23.911 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:35:24.011 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T10:35:24.026 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:24.069 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:24.248 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T10:35:24.269 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T10:35:24.280 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T10:35:24.295 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:24.306 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:35:24.330 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:24.591 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T10:35:24.607 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:24.634 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T10:35:24.646 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T10:35:24.649 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:24.684 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:35:24.929 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T10:35:24.949 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T10:35:24.969 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T10:35:24.978 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:35:24.985 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T10:35:25.027 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T10:35:25.282 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T10:35:25.297 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T10:35:25.302 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T10:35:25.313 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:25.339 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T10:35:25.355 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:25.642 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-portend. 2024-04-25T10:35:25.663 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T10:35:25.666 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T10:35:25.682 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T10:35:25.701 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T10:35:25.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:35:25.936 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T10:35:25.951 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T10:35:25.994 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:35:26.003 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T10:35:26.024 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T10:35:26.062 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T10:35:26.289 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T10:35:26.304 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T10:35:26.332 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T10:35:26.347 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:35:26.352 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T10:35:26.381 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:35:26.717 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2024-04-25T10:35:26.718 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T10:35:26.732 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T10:35:26.739 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T10:35:26.775 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:35:26.776 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T10:35:27.045 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2024-04-25T10:35:27.061 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T10:35:27.088 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T10:35:27.095 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T10:35:27.108 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T10:35:27.154 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T10:35:27.348 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2024-04-25T10:35:27.363 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T10:35:27.406 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T10:35:28.491 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T10:35:28.512 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T10:35:28.549 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:35:28.610 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2024-04-25T10:35:28.626 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T10:35:28.668 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:35:28.819 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-mako. 2024-04-25T10:35:28.830 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T10:35:28.860 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:35:29.006 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2024-04-25T10:35:29.021 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T10:35:29.056 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:35:29.164 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T10:35:29.184 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T10:35:29.222 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:35:29.489 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2024-04-25T10:35:29.504 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:29.525 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T10:35:29.545 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T10:35:29.547 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:29.583 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:35:29.902 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webob. 2024-04-25T10:35:29.923 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T10:35:29.960 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:35:30.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T10:35:30.107 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:30.149 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:30.273 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T10:35:30.293 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T10:35:30.333 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:35:30.453 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T10:35:30.468 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T10:35:30.502 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:35:30.608 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T10:35:30.629 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T10:35:30.666 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:35:30.839 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T10:35:30.858 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:30.897 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:30.969 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-paste. 2024-04-25T10:35:30.990 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T10:35:31.027 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:35:31.317 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2024-04-25T10:35:31.333 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:31.339 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T10:35:31.351 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T10:35:31.375 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:31.414 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:35:31.759 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T10:35:31.780 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T10:35:31.808 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:35:32.086 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T10:35:32.107 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T10:35:32.144 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T10:35:32.440 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T10:35:32.461 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T10:35:32.497 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:35:32.514 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2024-04-25T10:35:32.530 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:32.574 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:32.852 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T10:35:32.874 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T10:35:32.902 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T10:35:33.177 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T10:35:33.192 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T10:35:33.244 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:35:33.263 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-idna. 2024-04-25T10:35:33.284 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T10:35:33.352 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T10:35:33.597 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T10:35:33.612 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T10:35:33.643 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T10:35:33.647 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:35:33.664 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T10:35:33.701 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:35:33.934 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T10:35:33.949 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T10:35:33.983 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:35:34.030 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-requests. 2024-04-25T10:35:34.050 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T10:35:34.088 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:35:34.270 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T10:35:34.285 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T10:35:34.328 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:35:34.399 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T10:35:34.420 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T10:35:34.457 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:35:34.623 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T10:35:34.638 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T10:35:34.706 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:35:34.760 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T10:35:34.772 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:34.810 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:34.985 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T10:35:35.000 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T10:35:35.034 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T10:35:35.223 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T10:35:35.244 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:35.287 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2024-04-25T10:35:35.298 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:35.302 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T10:35:35.345 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T10:35:35.626 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T10:35:35.647 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T10:35:35.650 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T10:35:35.666 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T10:35:35.684 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:35:35.708 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T10:35:35.987 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T10:35:35.999 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T10:35:36.019 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T10:35:36.035 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T10:35:36.036 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T10:35:36.077 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:35:36.398 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T10:35:36.410 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:36.423 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T10:35:36.438 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T10:35:36.447 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:36.481 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T10:35:36.801 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T10:35:36.816 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T10:35:36.851 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T10:35:36.859 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T10:35:36.863 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:36.901 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:37.120 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T10:35:37.136 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T10:35:37.170 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:35:37.490 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2024-04-25T10:35:37.496 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T10:35:37.505 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T10:35:37.517 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:37.548 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:35:37.554 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:37.876 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T10:35:37.892 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T10:35:37.934 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:35:38.316 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T10:35:38.332 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T10:35:38.470 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:35:38.808 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph. 2024-04-25T10:35:38.815 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2024-04-25T10:35:38.820 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:38.830 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T10:35:38.857 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:38.873 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:35:39.160 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T10:35:39.181 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:39.218 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:39.218 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T10:35:39.233 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T10:35:39.279 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:35:39.571 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T10:35:39.571 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T10:35:39.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T10:35:39.593 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:39.629 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:35:39.629 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:39.873 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2024-04-25T10:35:39.889 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T10:35:39.974 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:35:40.058 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephadm. 2024-04-25T10:35:40.079 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:40.124 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:40.277 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T10:35:40.289 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T10:35:40.326 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:35:40.452 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T10:35:40.474 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T10:35:40.510 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T10:35:40.571 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T10:35:40.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T10:35:40.621 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:35:40.838 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T10:35:40.859 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:35:40.896 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:35:40.907 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T10:35:40.921 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T10:35:40.965 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T10:35:41.302 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T10:35:41.315 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T10:35:41.360 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:35:41.723 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T10:35:41.737 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T10:35:41.781 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T10:35:42.010 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-babel. 2024-04-25T10:35:42.031 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:35:42.076 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2024-04-25T10:35:42.090 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T10:35:42.093 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:35:42.126 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T10:35:42.404 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T10:35:42.404 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T10:35:42.418 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T10:35:42.425 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T10:35:42.462 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:35:42.462 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:35:42.790 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2024-04-25T10:35:42.804 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T10:35:42.824 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T10:35:42.846 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:42.848 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:35:42.890 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:43.202 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T10:35:43.215 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T10:35:43.227 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T10:35:43.248 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T10:35:43.260 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:35:43.285 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T10:35:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T10:35:43.526 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:43.571 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:43.588 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-routes. 2024-04-25T10:35:43.609 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T10:35:43.646 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:35:44.017 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T10:35:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T10:35:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:44.038 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:44.067 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:44.075 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:44.370 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T10:35:44.384 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T10:35:44.428 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:35:44.690 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T10:35:44.703 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T10:35:44.748 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T10:35:45.068 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T10:35:45.082 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:45.126 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:45.363 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T10:35:45.384 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T10:35:45.421 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:35:45.529 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T10:35:45.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:45.587 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:45.950 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T10:35:45.971 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T10:35:46.008 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:35:46.166 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T10:35:46.179 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:46.224 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:46.370 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T10:35:46.391 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T10:35:46.522 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:35:46.850 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T10:35:46.871 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T10:35:46.916 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:35:46.994 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2024-04-25T10:35:47.007 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:47.035 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:47.355 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T10:35:47.368 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:47.413 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:47.750 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T10:35:47.772 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:47.799 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T10:35:47.813 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:47.849 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:47.857 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:48.294 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2024-04-25T10:35:48.308 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:48.352 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:48.847 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T10:35:48.861 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T10:35:48.905 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T10:35:49.145 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T10:35:49.166 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T10:35:49.211 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T10:35:49.274 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T10:35:49.288 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:35:49.341 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:35:49.514 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T10:35:49.535 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T10:35:49.572 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:35:49.917 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T10:35:49.930 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T10:35:49.967 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:35:50.278 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T10:35:50.300 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T10:35:50.344 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T10:35:50.363 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2024-04-25T10:35:50.375 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:35:50.437 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:35:50.640 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T10:35:50.661 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T10:35:50.706 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T10:35:50.740 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T10:35:50.749 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T10:35:50.790 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:35:51.018 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T10:35:51.040 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T10:35:51.076 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:35:51.128 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T10:35:51.135 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:51.177 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:51.346 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T10:35:51.368 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T10:35:51.412 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T10:35:51.514 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T10:35:51.521 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T10:35:51.563 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T10:35:51.741 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T10:35:51.763 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T10:35:51.807 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:35:51.866 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2024-04-25T10:35:51.877 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T10:35:51.916 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:35:52.253 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T10:35:52.262 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:52.302 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:52.454 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T10:35:52.476 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:52.521 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:52.849 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T10:35:52.870 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T10:35:52.906 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:35:53.235 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T10:35:53.256 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:35:53.301 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:35:53.432 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T10:35:53.440 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T10:35:53.482 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:35:53.587 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package jq. 2024-04-25T10:35:53.609 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:35:53.645 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T10:35:53.881 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package socat. 2024-04-25T10:35:53.894 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T10:35:53.931 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:35:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T10:35:53.986 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T10:35:54.027 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:35:54.268 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T10:35:54.290 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T10:35:54.339 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T10:35:54.343 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:35:54.347 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T10:35:54.491 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:35:54.772 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-test. 2024-04-25T10:35:54.786 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T10:35:54.794 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:54.795 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T10:35:54.836 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:35:54.838 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:55.503 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T10:35:55.512 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:55.545 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:56.465 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T10:35:56.477 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T10:35:56.514 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T10:35:56.818 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T10:35:56.833 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T10:35:56.876 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:35:57.238 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T10:35:57.249 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T10:35:57.251 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T10:35:57.273 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:57.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:35:57.326 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:57.607 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T10:35:57.618 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T10:35:57.657 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T10:35:57.722 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T10:35:57.744 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:57.788 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:57.944 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T10:35:57.955 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T10:35:57.985 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T10:35:58.100 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T10:35:58.122 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T10:35:58.158 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T10:35:58.247 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T10:35:58.257 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T10:35:58.297 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:35:58.419 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T10:35:58.441 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:58.485 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:58.625 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T10:35:58.636 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T10:35:58.675 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T10:35:58.730 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T10:35:58.742 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:58.780 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:59.015 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T10:35:59.028 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:35:59.039 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T10:35:59.053 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T10:35:59.057 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:35:59.212 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:35:59.518 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T10:35:59.540 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T10:35:59.576 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:35:59.934 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T10:35:59.944 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:35:59.948 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T10:35:59.969 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T10:35:59.984 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:00.014 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:36:00.306 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T10:36:00.314 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T10:36:00.353 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:36:00.402 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T10:36:00.423 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T10:36:00.468 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:36:00.623 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T10:36:00.634 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:36:00.664 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:36:00.890 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package pkg-config. 2024-04-25T10:36:00.909 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2024-04-25T10:36:00.912 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T10:36:00.919 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:36:00.956 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:36:00.958 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T10:36:01.193 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T10:36:01.214 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T10:36:01.245 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2024-04-25T10:36:01.255 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T10:36:01.259 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:36:01.295 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:36:01.606 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T10:36:01.617 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T10:36:01.656 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:36:01.704 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T10:36:01.726 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T10:36:01.762 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T10:36:02.010 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2024-04-25T10:36:02.020 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:02.031 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T10:36:02.053 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T10:36:02.060 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:02.097 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T10:36:02.401 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T10:36:02.423 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T10:36:02.468 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:36:02.779 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T10:36:02.801 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T10:36:02.845 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T10:36:03.182 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-py. 2024-04-25T10:36:03.194 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T10:36:03.250 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T10:36:03.560 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T10:36:03.582 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T10:36:03.626 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:36:04.097 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T10:36:04.114 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T10:36:04.119 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T10:36:04.125 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:36:04.155 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:36:04.164 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:04.441 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-toml. 2024-04-25T10:36:04.463 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T10:36:04.507 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T10:36:04.543 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T10:36:04.554 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:04.593 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:04.811 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T10:36:04.833 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T10:36:04.863 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T10:36:04.876 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T10:36:04.877 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:36:04.913 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T10:36:05.132 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T10:36:05.143 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:36:05.207 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:05.256 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T10:36:05.277 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T10:36:05.322 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:36:05.468 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T10:36:05.479 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T10:36:05.517 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:05.600 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T10:36:05.621 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T10:36:05.666 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:36:05.770 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T10:36:05.782 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:05.820 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:06.131 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T10:36:06.143 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T10:36:06.181 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:36:06.412 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package radosgw. 2024-04-25T10:36:06.434 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:06.478 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:06.536 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T10:36:06.548 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T10:36:06.585 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:36:06.906 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T10:36:06.923 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T10:36:06.964 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:36:07.336 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2024-04-25T10:36:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T10:36:07.381 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T10:36:07.386 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:36:07.394 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:07.431 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:07.639 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T10:36:07.653 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T10:36:07.697 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:36:07.742 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T10:36:08.003 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:36:08.104 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:36:08.117 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T10:36:08.130 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T10:36:08.175 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T10:36:08.368 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T10:36:08.486 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T10:36:08.500 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T10:36:08.536 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T10:36:08.747 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T10:36:08.815 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T10:36:08.828 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T10:36:08.864 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:36:09.200 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T10:36:09.214 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T10:36:09.226 INFO:teuthology.orchestra.run.smithi186.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T10:36:09.323 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:09.475 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T10:36:09.829 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2024-04-25T10:36:09.842 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T10:36:09.844 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user cephadm....done 2024-04-25T10:36:09.887 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T10:36:10.064 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:36:10.165 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T10:36:10.179 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T10:36:10.215 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:36:10.451 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:36:10.694 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T10:36:10.707 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T10:36:10.744 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:36:10.766 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:36:10.982 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:36:11.030 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2024-04-25T10:36:11.044 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T10:36:11.080 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T10:36:11.310 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T10:36:11.349 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T10:36:11.362 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T10:36:11.407 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:36:11.578 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:36:11.704 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T10:36:11.728 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T10:36:11.741 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T10:36:11.811 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:36:12.006 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:36:12.072 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T10:36:12.086 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T10:36:12.122 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:36:12.391 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T10:36:12.651 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T10:36:12.800 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2024-04-25T10:36:12.813 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:12.850 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:12.893 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T10:36:13.153 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:36:13.388 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:36:13.706 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T10:36:13.719 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T10:36:13.763 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:13.831 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:36:14.058 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T10:36:14.123 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:36:14.374 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:14.385 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:36:14.511 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:36:14.625 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:36:14.760 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:36:14.807 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T10:36:14.886 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T10:36:15.154 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:36:15.225 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T10:36:15.263 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:36:15.522 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:36:15.856 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T10:36:15.902 INFO:teuthology.orchestra.run.smithi016.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T10:36:15.914 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T10:36:15.946 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:15.970 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T10:36:16.028 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:36:16.154 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T10:36:16.449 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2024-04-25T10:36:16.505 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:36:16.602 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:36:16.622 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T10:36:16.882 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:36:16.887 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:36:17.141 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:36:17.189 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:36:17.306 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:36:17.484 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T10:36:17.557 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T10:36:17.585 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:36:17.817 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:36:17.918 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T10:36:18.228 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:36:18.245 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:36:18.496 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:36:18.614 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T10:36:18.622 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:36:18.748 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:36:18.881 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T10:36:19.041 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T10:36:19.133 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T10:36:19.400 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T10:36:19.421 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:36:19.635 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:36:19.935 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:36:20.012 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:36:20.270 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:36:20.305 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T10:36:20.538 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:36:20.606 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:36:20.805 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:20.957 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:36:21.056 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:36:21.182 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:36:21.191 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:36:21.283 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T10:36:21.317 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:21.559 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:36:21.593 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T10:36:21.702 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:36:21.937 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:36:21.978 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:36:22.377 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T10:36:22.441 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T10:36:22.506 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:36:22.607 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T10:36:22.975 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:36:23.101 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T10:36:23.150 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:36:23.377 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:23.377 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:36:23.511 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T10:36:23.653 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:36:23.771 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:36:23.897 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:36:23.996 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T10:36:24.022 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:36:24.097 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:36:24.316 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:36:24.566 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T10:36:24.793 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:24.799 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:36:24.902 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:36:25.084 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:36:25.210 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:36:25.212 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:36:25.336 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:36:25.463 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T10:36:25.662 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T10:36:25.739 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T10:36:25.998 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:36:26.063 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T10:36:26.249 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T10:36:26.314 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:36:26.492 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:36:26.601 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T10:36:26.716 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:36:26.878 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:36:27.004 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:36:27.008 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T10:36:27.305 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:36:27.335 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:36:27.606 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:36:27.703 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:36:27.865 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:36:27.987 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:36:28.016 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:36:28.088 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:28.134 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:36:28.206 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T10:36:28.381 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T10:36:28.444 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:36:28.578 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:36:28.741 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:36:28.972 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:36:29.247 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T10:36:29.373 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T10:36:29.624 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:29.767 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:36:30.022 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:36:30.248 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:30.388 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:36:30.416 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T10:36:30.686 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:36:30.692 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:36:30.818 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:36:30.944 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:36:30.962 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T10:36:31.173 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T10:36:31.262 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:36:31.441 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T10:36:31.522 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T10:36:31.717 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:36:31.798 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:31.924 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:36:31.968 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:36:32.250 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:36:32.345 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T10:36:32.518 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T10:36:32.629 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:36:32.794 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T10:36:32.965 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:36:33.062 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:36:33.091 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:33.209 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:33.321 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T10:36:33.335 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:36:33.597 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:36:33.671 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:33.715 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T10:36:33.797 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:33.923 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T10:36:34.000 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:36:34.126 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:36:34.216 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:34.342 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:34.443 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:34.460 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:36:34.649 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:36:34.649 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:36:34.778 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:36:35.054 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:36:35.161 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:35.197 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:36:35.304 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:35.306 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:36:35.378 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T10:36:35.447 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:35.573 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:35.633 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:36:35.699 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:36:35.758 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:36:36.169 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:36:36.453 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T10:36:36.570 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T10:36:36.854 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:36:36.910 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:36.956 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:36:37.037 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:37.162 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:37.282 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:36:37.288 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:37.415 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:37.524 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:37.583 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:36:37.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T10:36:38.016 INFO:teuthology.orchestra.run.smithi186.stdout:Adding group ceph....done 2024-04-25T10:36:38.079 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T10:36:38.372 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T10:36:38.426 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user ceph....done 2024-04-25T10:36:38.603 INFO:teuthology.orchestra.run.smithi186.stdout:Setting system user ceph properties....done 2024-04-25T10:36:38.616 INFO:teuthology.orchestra.run.smithi186.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T10:36:38.657 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:36:38.752 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T10:36:38.925 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:36:39.148 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T10:36:39.318 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T10:36:39.620 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:36:39.691 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:39.912 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:36:39.912 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:36:39.972 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:36:40.082 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.232 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.358 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:36:40.435 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.628 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.695 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.846 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:40.947 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T10:36:41.113 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:36:41.113 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:36:41.232 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:41.358 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:41.484 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:41.646 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:41.705 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:36:41.705 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:36:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T10:36:42.360 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:42.486 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:42.548 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:42.612 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:42.730 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:42.762 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:36:42.762 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:36:42.831 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:36:43.250 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:43.467 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:36:43.467 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:36:43.976 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.151 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.294 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:36:44.294 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:36:44.403 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.538 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.647 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.790 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.853 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:44.979 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:45.130 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:45.337 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2024-04-25T10:36:45.365 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:36:45.365 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:36:45.736 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2024-04-25T10:36:45.864 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:45.922 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2024-04-25T10:36:45.944 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T10:36:46.007 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:46.100 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T10:36:46.125 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:46.259 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:46.515 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T10:36:46.587 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:36:46.688 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:36:46.840 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:36:47.208 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:47.424 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:36:47.424 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:36:47.924 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:36:48.067 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:48.193 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:48.573 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:36:48.576 DEBUG:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T10:36:48.628 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2024-04-25T10:36:48.741 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:36:48.742 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:36:48.817 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2024-04-25T10:36:48.817 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:36:48.990 INFO:teuthology.orchestra.run.smithi186.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:36:48.991 INFO:teuthology.orchestra.run.smithi186.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:36:48.991 INFO:teuthology.orchestra.run.smithi186.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T10:36:48.991 INFO:teuthology.orchestra.run.smithi186.stdout: python2.7-minimal 2024-04-25T10:36:48.991 INFO:teuthology.orchestra.run.smithi186.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T10:36:48.992 INFO:teuthology.orchestra.run.smithi186.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:36:48.994 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2024-04-25T10:36:48.994 INFO:teuthology.orchestra.run.smithi186.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T10:36:48.994 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T10:36:48.994 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T10:36:49.033 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2024-04-25T10:36:49.033 INFO:teuthology.orchestra.run.smithi186.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T10:36:49.033 INFO:teuthology.orchestra.run.smithi186.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T10:36:49.034 INFO:teuthology.orchestra.run.smithi186.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T10:36:49.034 INFO:teuthology.orchestra.run.smithi186.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T10:36:49.034 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T10:36:49.034 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T10:36:49.034 INFO:teuthology.orchestra.run.smithi186.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:36:49.035 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages will be upgraded: 2024-04-25T10:36:49.036 INFO:teuthology.orchestra.run.smithi186.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T10:36:49.094 INFO:teuthology.orchestra.run.smithi186.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T10:36:49.094 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 55.7 MB of archives. 2024-04-25T10:36:49.094 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T10:36:49.094 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T10:36:49.255 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T10:36:49.261 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T10:36:49.302 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T10:36:49.303 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T10:36:49.303 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T10:36:49.314 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T10:36:49.315 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T10:36:49.317 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T10:36:49.319 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T10:36:49.319 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T10:36:49.320 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T10:36:49.324 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T10:36:49.343 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T10:36:49.343 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T10:36:49.344 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T10:36:49.378 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:49.678 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T10:36:49.680 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T10:36:49.680 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T10:36:49.682 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T10:36:49.683 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T10:36:49.687 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T10:36:49.688 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T10:36:49.695 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T10:36:49.695 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T10:36:49.714 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T10:36:49.717 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T10:36:49.730 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T10:36:49.751 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T10:36:49.753 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T10:36:49.754 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T10:36:49.755 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T10:36:49.755 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T10:36:49.755 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T10:36:49.767 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T10:36:49.768 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T10:36:49.989 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T10:36:49.990 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T10:36:49.990 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T10:36:49.990 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T10:36:49.990 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T10:36:49.990 INFO:teuthology.orchestra.run.smithi186.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T10:36:50.001 INFO:teuthology.orchestra.run.smithi186.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T10:36:50.001 INFO:teuthology.orchestra.run.smithi186.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T10:36:50.411 INFO:teuthology.orchestra.run.smithi186.stdout:Preconfiguring packages ... 2024-04-25T10:36:50.600 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 55.7 MB in 1s (58.1 MB/s) 2024-04-25T10:36:50.769 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:51.012 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:36:51.012 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:36:51.073 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-25T10:36:51.078 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:36:51.196 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:36:51.691 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:51.841 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T10:36:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:36:51.912 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:36:52.601 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:52.817 INFO:teuthology.orchestra.run.smithi186.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T10:36:52.912 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:36:52.913 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:36:53.042 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package flex. 2024-04-25T10:36:53.093 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138504 files and directories currently installed.) 2024-04-25T10:36:53.097 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T10:36:53.134 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T10:36:53.569 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:53.677 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:36:53.696 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:53.838 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:53.847 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T10:36:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:36:54.072 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:36:54.273 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:36:54.740 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:54.816 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-25T10:36:54.820 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:36:54.891 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:54.955 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:36:55.017 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:55.160 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T10:36:55.357 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:36:55.495 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:36:55.571 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:36:55.748 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:36:55.811 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:36:55.908 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:36:56.346 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package bison. 2024-04-25T10:36:56.437 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138577 files and directories currently installed.) 2024-04-25T10:36:56.442 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T10:36:56.499 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:36:56.907 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T10:36:56.929 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T10:36:56.974 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:36:57.026 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:36:57.285 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package dump. 2024-04-25T10:36:57.307 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T10:36:57.352 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T10:36:57.664 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package indent. 2024-04-25T10:36:57.676 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:36:57.714 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:36:57.731 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:36:57.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T10:36:57.811 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2024-04-25T10:36:57.997 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2024-04-25T10:36:57.998 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2024-04-25T10:36:58.008 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T10:36:58.021 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T10:36:58.058 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:36:58.182 INFO:teuthology.orchestra.run.smithi016.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T10:36:58.182 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:36:58.183 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:36:58.184 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2024-04-25T10:36:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T10:36:58.184 INFO:teuthology.orchestra.run.smithi016.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T10:36:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T10:36:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T10:36:58.185 INFO:teuthology.orchestra.run.smithi016.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:36:58.186 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2024-04-25T10:36:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T10:36:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T10:36:58.186 INFO:teuthology.orchestra.run.smithi016.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T10:36:58.242 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2024-04-25T10:36:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T10:36:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T10:36:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T10:36:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T10:36:58.243 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T10:36:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T10:36:58.244 INFO:teuthology.orchestra.run.smithi016.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:36:58.245 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2024-04-25T10:36:58.245 INFO:teuthology.orchestra.run.smithi016.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T10:36:58.309 INFO:teuthology.orchestra.run.smithi016.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T10:36:58.310 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 55.7 MB of archives. 2024-04-25T10:36:58.310 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T10:36:58.310 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T10:36:58.354 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T10:36:58.374 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T10:36:58.412 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:36:58.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T10:36:58.485 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T10:36:58.519 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T10:36:58.520 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T10:36:58.520 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T10:36:58.528 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T10:36:58.529 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T10:36:58.531 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T10:36:58.532 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T10:36:58.532 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T10:36:58.533 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T10:36:58.544 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T10:36:58.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T10:36:58.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T10:36:58.565 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T10:36:58.631 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T10:36:58.653 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T10:36:58.698 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:36:58.847 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T10:36:58.849 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T10:36:58.850 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T10:36:58.852 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T10:36:58.853 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T10:36:58.857 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T10:36:58.859 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T10:36:58.866 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T10:36:58.867 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T10:36:58.888 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T10:36:58.890 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T10:36:58.901 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T10:36:58.925 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T10:36:58.931 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T10:36:58.931 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T10:36:58.932 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T10:36:58.933 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T10:36:58.944 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T10:36:58.948 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T10:36:59.051 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T10:36:59.073 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T10:36:59.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T10:36:59.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T10:36:59.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T10:36:59.106 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T10:36:59.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T10:36:59.107 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T10:36:59.118 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:36:59.120 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T10:36:59.121 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T10:36:59.371 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T10:36:59.386 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T10:36:59.429 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:36:59.516 INFO:teuthology.orchestra.run.smithi016.stdout:Preconfiguring packages ... 2024-04-25T10:36:59.674 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 55.7 MB in 1s (64.3 MB/s) 2024-04-25T10:36:59.690 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T10:36:59.711 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T10:36:59.756 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T10:36:59.915 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T10:36:59.919 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:37:00.032 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:37:00.043 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T10:37:00.065 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T10:37:00.109 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:37:00.677 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T10:37:01.931 INFO:teuthology.orchestra.run.smithi016.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T10:37:02.172 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2024-04-25T10:37:02.244 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T10:37:02.248 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T10:37:02.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T10:37:02.455 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T10:37:02.476 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:37:02.521 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:02.790 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T10:37:02.803 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:37:02.840 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:02.857 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:37:03.035 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T10:37:03.218 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T10:37:03.240 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:37:03.284 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:03.469 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:37:03.688 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T10:37:03.709 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T10:37:03.762 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:37:04.036 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T10:37:04.040 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:37:04.165 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T10:37:04.187 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:37:04.192 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:37:04.240 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:37:04.626 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T10:37:04.648 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:04.655 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:37:04.693 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:04.799 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:37:05.106 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T10:37:05.116 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:37:05.128 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:05.181 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:05.483 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2024-04-25T10:37:05.562 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T10:37:05.566 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T10:37:05.610 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:37:05.676 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T10:37:05.698 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:05.750 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:06.003 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T10:37:06.025 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:37:06.069 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:37:06.070 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T10:37:06.086 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T10:37:06.128 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:37:06.466 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2024-04-25T10:37:06.483 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T10:37:06.525 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T10:37:06.657 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T10:37:06.678 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T10:37:06.748 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:37:06.795 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2024-04-25T10:37:06.812 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:06.853 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:37:07.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T10:37:07.107 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T10:37:07.148 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:37:07.226 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package modemmanager. 2024-04-25T10:37:07.248 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:37:07.436 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:07.485 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T10:37:07.501 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T10:37:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:37:07.796 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T10:37:07.812 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T10:37:07.854 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:37:08.178 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T10:37:08.191 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T10:37:08.233 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:08.318 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager. 2024-04-25T10:37:08.340 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:37:08.401 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:37:08.510 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T10:37:08.527 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T10:37:08.569 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:08.821 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T10:37:08.838 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T10:37:08.880 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T10:37:09.051 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ppp. 2024-04-25T10:37:09.072 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T10:37:09.183 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T10:37:09.199 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T10:37:09.233 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:37:09.386 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:37:09.738 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T10:37:09.761 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T10:37:09.805 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T10:37:10.033 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T10:37:10.055 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T10:37:10.099 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T10:37:10.436 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T10:37:10.458 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T10:37:10.502 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T10:37:10.736 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T10:37:10.752 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:37:10.789 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T10:37:10.794 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:10.811 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:10.855 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:11.115 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T10:37:11.132 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:37:11.199 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:11.444 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T10:37:11.460 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T10:37:11.466 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T10:37:11.476 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:37:11.510 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:11.529 INFO:teuthology.orchestra.run.smithi186.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T10:37:11.550 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-common (238) ... 2024-04-25T10:37:11.846 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T10:37:11.862 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T10:37:11.905 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:37:12.034 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T10:37:12.058 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:12.104 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:12.215 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T10:37:12.231 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:37:12.274 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:37:12.602 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T10:37:12.618 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:12.651 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:12.980 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T10:37:12.996 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:13.038 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:13.324 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T10:37:13.340 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:13.382 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:13.454 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql. 2024-04-25T10:37:13.477 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T10:37:13.520 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql (14+238) ... 2024-04-25T10:37:13.618 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T10:37:13.634 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:37:13.676 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:37:13.797 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T10:37:13.819 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T10:37:13.872 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T10:37:14.116 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T10:37:14.129 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T10:37:14.166 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T10:37:14.230 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T10:37:14.246 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T10:37:14.288 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:37:14.486 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T10:37:14.510 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T10:37:14.552 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:37:14.608 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package modemmanager. 2024-04-25T10:37:14.625 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:37:14.666 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:14.796 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package tcl. 2024-04-25T10:37:14.809 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T10:37:14.851 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T10:37:15.208 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T10:37:15.230 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T10:37:15.274 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:37:15.332 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager. 2024-04-25T10:37:15.348 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:37:15.398 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:37:15.662 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T10:37:15.684 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T10:37:15.720 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T10:37:16.006 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ppp. 2024-04-25T10:37:16.022 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T10:37:16.082 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T10:37:16.104 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T10:37:16.156 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:37:16.450 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T10:37:16.595 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:37:16.637 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T10:37:16.763 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:37:16.890 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:16.963 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T10:37:16.977 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T10:37:17.015 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:37:17.020 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T10:37:17.142 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:37:17.257 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T10:37:17.272 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T10:37:17.293 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:17.315 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T10:37:17.627 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T10:37:17.642 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T10:37:17.685 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T10:37:17.790 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T10:37:17.872 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:37:18.014 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T10:37:18.030 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:18.072 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:18.303 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:37:18.303 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:37:18.643 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T10:37:18.659 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T10:37:18.720 INFO:teuthology.orchestra.run.smithi016.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T10:37:18.751 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-common (238) ... 2024-04-25T10:37:18.864 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:37:18.985 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:37:19.128 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:37:19.242 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T10:37:19.254 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T10:37:19.259 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:37:19.303 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:19.380 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:37:19.505 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:19.623 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:37:19.724 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:37:20.321 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:37:20.447 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T10:37:20.504 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql. 2024-04-25T10:37:20.519 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T10:37:20.557 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T10:37:20.562 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql (14+238) ... 2024-04-25T10:37:20.623 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:20.724 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:37:20.789 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T10:37:20.804 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T10:37:20.847 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T10:37:20.859 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T10:37:20.985 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T10:37:21.083 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T10:37:21.098 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T10:37:21.133 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T10:37:21.152 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:37:21.243 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T10:37:21.312 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:37:21.413 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:37:21.556 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:37:21.675 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:21.800 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T10:37:21.811 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T10:37:21.827 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T10:37:21.868 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:37:21.968 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T10:37:22.094 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:37:22.163 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl. 2024-04-25T10:37:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T10:37:22.226 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T10:37:22.574 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T10:37:22.591 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:which means they are currently configured by ifupdown: 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:- enp3s0f1 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T10:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:22.632 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:37:22.719 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T10:37:22.995 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T10:37:23.012 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T10:37:23.056 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T10:37:23.062 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T10:37:23.431 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T10:37:23.448 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T10:37:23.450 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T10:37:23.498 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:37:23.801 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T10:37:23.930 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:24.029 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T10:37:24.048 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:24.130 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:37:24.174 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T10:37:24.256 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:24.325 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-common (238) ... 2024-04-25T10:37:24.407 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:37:24.533 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:37:24.651 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:25.222 INFO:teuthology.orchestra.run.smithi186.stdout:Adding user postgres to group ssl-cert 2024-04-25T10:37:25.374 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:25.374 INFO:teuthology.orchestra.run.smithi186.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T10:37:25.573 INFO:teuthology.orchestra.run.smithi186.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T10:37:25.573 INFO:teuthology.orchestra.run.smithi186.stdout:Removing obsolete dictionary files: 2024-04-25T10:37:25.614 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T10:37:25.723 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:37:26.111 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:37:26.111 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:37:26.183 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T10:37:26.585 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:26.860 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:37:26.922 INFO:teuthology.orchestra.run.smithi186.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T10:37:26.941 INFO:teuthology.orchestra.run.smithi186.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:This user must also own the server process. 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:The default text search configuration will be set to "english". 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:26.987 INFO:teuthology.orchestra.run.smithi186.stdout:Data page checksums are disabled. 2024-04-25T10:37:26.988 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:26.988 INFO:teuthology.orchestra.run.smithi186.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T10:37:26.988 INFO:teuthology.orchestra.run.smithi186.stdout:creating subdirectories ... ok 2024-04-25T10:37:26.988 INFO:teuthology.orchestra.run.smithi186.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T10:37:27.003 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:37:27.004 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default max_connections ... 100 2024-04-25T10:37:27.025 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default shared_buffers ... 128MB 2024-04-25T10:37:27.036 INFO:teuthology.orchestra.run.smithi186.stdout:selecting default time zone ... Etc/UTC 2024-04-25T10:37:27.037 INFO:teuthology.orchestra.run.smithi186.stdout:creating configuration files ... ok 2024-04-25T10:37:27.129 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:37:27.151 INFO:teuthology.orchestra.run.smithi186.stdout:running bootstrap script ... ok 2024-04-25T10:37:27.280 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T10:37:27.406 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:37:27.532 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:27.658 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:37:27.792 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:37:27.803 INFO:teuthology.orchestra.run.smithi186.stdout:performing post-bootstrap initialization ... ok 2024-04-25T10:37:28.618 INFO:teuthology.orchestra.run.smithi186.stdout:syncing data to disk ... ok 2024-04-25T10:37:28.835 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:37:29.033 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T10:37:29.079 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T10:37:29.251 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T10:37:29.349 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:29.594 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:37:29.745 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T10:37:29.854 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T10:37:29.980 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:37:30.070 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T10:37:30.132 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:37:30.258 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:37:30.443 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:37:30.585 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:30.703 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T10:37:30.838 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T10:37:30.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:37:31.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:31.626 INFO:teuthology.orchestra.run.smithi016.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T10:37:31.626 INFO:teuthology.orchestra.run.smithi016.stdout:which means they are currently configured by ifupdown: 2024-04-25T10:37:31.627 INFO:teuthology.orchestra.run.smithi016.stdout:- ens1f0 2024-04-25T10:37:31.627 INFO:teuthology.orchestra.run.smithi016.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T10:37:31.627 INFO:teuthology.orchestra.run.smithi016.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T10:37:31.627 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:31.767 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T10:37:31.967 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:32.092 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T10:37:32.200 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T10:37:32.218 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up postgresql (14+238) ... 2024-04-25T10:37:32.344 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:32.470 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:32.645 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T10:37:32.703 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:37:32.703 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:37:33.315 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:37:33.391 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:37:33.407 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T10:37:33.560 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:37:33.686 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T10:37:33.743 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:37:33.795 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-common (238) ... 2024-04-25T10:37:33.895 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:37:34.688 INFO:teuthology.orchestra.run.smithi016.stdout:Adding user postgres to group ssl-cert 2024-04-25T10:37:35.029 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:35.029 INFO:teuthology.orchestra.run.smithi016.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T10:37:35.288 INFO:teuthology.orchestra.run.smithi016.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T10:37:35.288 INFO:teuthology.orchestra.run.smithi016.stdout:Removing obsolete dictionary files: 2024-04-25T10:37:35.764 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T10:37:35.872 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:37:36.039 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T10:37:36.359 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:37:36.365 DEBUG:teuthology.parallel:result is None 2024-04-25T10:37:36.488 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:37:36.843 INFO:teuthology.orchestra.run.smithi016.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T10:37:36.860 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:This user must also own the server process. 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:The default text search configuration will be set to "english". 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:Data page checksums are disabled. 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:36.919 INFO:teuthology.orchestra.run.smithi016.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T10:37:36.920 INFO:teuthology.orchestra.run.smithi016.stdout:creating subdirectories ... ok 2024-04-25T10:37:36.920 INFO:teuthology.orchestra.run.smithi016.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T10:37:36.944 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default max_connections ... 100 2024-04-25T10:37:36.979 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default shared_buffers ... 128MB 2024-04-25T10:37:36.994 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default time zone ... Etc/UTC 2024-04-25T10:37:36.995 INFO:teuthology.orchestra.run.smithi016.stdout:creating configuration files ... ok 2024-04-25T10:37:37.168 INFO:teuthology.orchestra.run.smithi016.stdout:running bootstrap script ... ok 2024-04-25T10:37:37.798 INFO:teuthology.orchestra.run.smithi016.stdout:performing post-bootstrap initialization ... ok 2024-04-25T10:37:38.343 INFO:teuthology.orchestra.run.smithi016.stdout:syncing data to disk ... ok 2024-04-25T10:37:38.874 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T10:37:41.846 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:41.963 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T10:37:42.089 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql (14+238) ... 2024-04-25T10:37:42.215 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:37:42.341 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:37:42.619 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:37:42.619 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:37:43.452 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:37:43.536 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T10:37:43.871 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:37:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:37:45.158 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T10:37:45.350 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:37:45.917 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:37:45.923 DEBUG:teuthology.parallel:result is None 2024-04-25T10:37:45.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:37:46.149 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2024-04-25T10:37:46.172 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:37:46.173 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:37:46.173 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T10:37:46.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:37:46.393 DEBUG:teuthology.orchestra.run.smithi186:> dpkg-query -W -f '${Version}' ceph 2024-04-25T10:37:46.413 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:37:46.414 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T10:37:46.414 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T10:37:46.416 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T10:37:46.416 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:46.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:37:46.437 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:46.437 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:37:46.470 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T10:37:46.470 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:46.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:37:46.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:37:46.559 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:46.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:37:46.573 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:37:46.628 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T10:37:46.629 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:46.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:37:46.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:37:46.711 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:46.711 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:37:46.724 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:37:46.780 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T10:37:46.781 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:46.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:37:46.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:37:46.864 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:46.864 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:37:46.877 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:37:46.932 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T10:37:47.022 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T10:37:47.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-25T10:37:47.026 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2024-04-25T10:37:47.044 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T10:37:47.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:37:47.090 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:37:47.107 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T10:37:47.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:37:47.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:37:47.178 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T10:37:47.178 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T10:37:47.179 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T10:37:47.179 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:47.179 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:37:47.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:37:47.317 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:47.317 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:37:47.323 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:37:47.402 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T10:37:47.402 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T10:37:47.402 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/lockdep}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673075', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'valgrind': {'exit_on_first_error': False}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOnfFU/FF+A2FgDaFtev8AlM5doMod2oZzT/AnVHnwh6irdWE0pyUdxPBIY9Ws1T4/dL0RdwiVuWNhnavBID5I8=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCFq/PBymE06v6A11PyL/Sj2ZIQRTxhAUYCEJYpNgnPlG2BagAriIIrElLNeKy/E96PRn2wGq8lj6CrUvsi8ZjY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'valgrind': {'exit_on_first_error': False}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T10:37:47.403 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:37:47.406 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:37:47.446 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:37:47.458 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:37:47.501 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:47.501 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:37:47.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:37:47.528 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-25T10:37:47.580 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-25 10:31:11.802327352 +0000 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-25 10:31:11.798327388 +0000 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-25 10:31:11.798327388 +0000 2024-04-25T10:37:47.581 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-25 10:31:11.798327388 +0000 2024-04-25T10:37:47.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:37:47.642 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-25T10:37:47.643 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-25T10:37:47.643 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000262191 s, 2.0 MB/s 2024-04-25T10:37:47.644 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:37:47.698 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-25T10:37:47.748 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-25 10:31:12.618320073 +0000 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-25 10:31:12.350322464 +0000 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-25 10:31:12.350322464 +0000 2024-04-25T10:37:47.749 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-25 10:31:12.350322464 +0000 2024-04-25T10:37:47.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:37:47.811 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-25T10:37:47.811 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-25T10:37:47.811 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000264138 s, 1.9 MB/s 2024-04-25T10:37:47.813 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:37:47.870 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-25T10:37:47.924 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-25 10:31:13.266314292 +0000 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-25 10:31:12.958317040 +0000 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-25 10:31:12.958317040 +0000 2024-04-25T10:37:47.925 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-25 10:31:12.958317040 +0000 2024-04-25T10:37:47.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:37:47.987 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-25T10:37:47.987 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-25T10:37:47.987 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000259808 s, 2.0 MB/s 2024-04-25T10:37:47.989 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:37:48.043 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-25T10:37:48.092 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 949 Links: 1 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-25 10:31:13.786309654 +0000 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-25 10:31:13.510312116 +0000 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-25 10:31:13.510312116 +0000 2024-04-25T10:37:48.093 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-25 10:31:13.510312116 +0000 2024-04-25T10:37:48.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:37:48.155 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-25T10:37:48.155 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-25T10:37:48.155 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000260388 s, 2.0 MB/s 2024-04-25T10:37:48.157 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:37:48.211 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:48.211 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:48.211 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:37:48.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:37:48.217 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-04-25T10:37:48.265 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 10:30:48.681492745 +0000 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 10:30:48.417494980 +0000 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 10:30:48.417494980 +0000 2024-04-25T10:37:48.266 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-25T10:37:48.266 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:37:48.319 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T10:37:48.319 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T10:37:48.320 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000604589 s, 847 kB/s 2024-04-25T10:37:48.321 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:37:48.370 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-04-25T10:37:48.416 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 10:30:49.201488343 +0000 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 10:30:48.937490577 +0000 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 10:30:48.937490577 +0000 2024-04-25T10:37:48.417 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-25T10:37:48.417 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:37:48.471 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T10:37:48.472 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T10:37:48.472 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000503156 s, 1.0 MB/s 2024-04-25T10:37:48.473 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:37:48.522 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 10:30:49.733483837 +0000 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 10:30:49.453486208 +0000 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 10:30:49.453486208 +0000 2024-04-25T10:37:48.569 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-25T10:37:48.570 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:37:48.623 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T10:37:48.623 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T10:37:48.623 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.00054849 s, 933 kB/s 2024-04-25T10:37:48.624 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:37:48.674 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-04-25T10:37:48.720 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-04-25 10:30:50.233479603 +0000 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-04-25 10:30:49.973481805 +0000 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-04-25 10:30:49.973481805 +0000 2024-04-25T10:37:48.721 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2024-04-25T10:37:48.721 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:37:48.775 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-04-25T10:37:48.775 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-04-25T10:37:48.775 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.00043232 s, 1.2 MB/s 2024-04-25T10:37:48.776 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:37:48.826 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:48.826 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:37:48.826 INFO:tasks.ceph:Generating config... 2024-04-25T10:37:48.827 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T10:37:48.827 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T10:37:48.828 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T10:37:48.828 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T10:37:48.828 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T10:37:48.828 INFO:tasks.ceph:[global] lockdep = True 2024-04-25T10:37:48.828 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T10:37:48.828 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T10:37:48.829 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T10:37:48.829 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T10:37:48.830 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T10:37:48.830 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T10:37:48.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T10:37:48.892 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T10:37:48.913 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T10:37:48.972 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:37:48.992 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.186'), ('mon.c', '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]')] 2024-04-25T10:37:48.993 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]', 'lockdep': True, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T10:37:48.993 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:48.993 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:37:49.043 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.186 --addv c '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:49.141 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:49.141 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 0bf3f6ca-8da3-483e-865e-01c1c2057abb 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 0bf3f6ca-8da3-483e-865e-01c1c2057abb 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-25T10:37:49.142488+0000 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-25T10:37:49.142488+0000 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] mon.c 2024-04-25T10:37:49.142 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T10:37:49.145 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:37:49.153 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0bf3f6ca-8da3-483e-865e-01c1c2057abb... 2024-04-25T10:37:49.154 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:37:49.202 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:37:49.234 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2024-04-25T10:37:49.234 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2024-04-25T10:37:49.234 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:37:49.234 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2024-04-25T10:37:49.235 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:37:49.236 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.16,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: lockdep = True 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on skipped message = False 2024-04-25T10:37:49.237 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = 0bf3f6ca-8da3-483e-865e-01c1c2057abb 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2024-04-25T10:37:49.238 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug trim objects = true 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.239 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore compression mode = aggressive 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 20 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 20 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 10 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2024-04-25T10:37:49.240 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T10:37:49.241 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:37:49.242 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: mon down mkfs grace = 300 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:37:49.243 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.e] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-04-25T10:37:49.244 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.f] 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds balancer = 20 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2024-04-25T10:37:49.245 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T10:37:49.246 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.247 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-25T10:37:49.248 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-25T10:37:49.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: lockdep = True 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 0bf3f6ca-8da3-483e-865e-01c1c2057abb 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.250 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.251 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore compression mode = aggressive 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 20 2024-04-25T10:37:49.252 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 20 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 10 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-25T10:37:49.253 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-25T10:37:49.254 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:37:49.255 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: mon down mkfs grace = 300 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:37:49.256 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-25T10:37:49.257 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2024-04-25T10:37:49.258 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2024-04-25T10:37:49.260 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T10:37:49.260 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T10:37:49.375 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T10:37:49.376 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:49.376 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T10:37:49.386 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:49.386 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T10:37:49.435 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:37:49.436 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:49.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:37:49.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:37:49.511 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:37:49.511 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:49.560 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:37:49.560 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:49.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:37:49.560 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:37:49.582 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:37:49.583 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:49.629 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T10:37:49.629 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T10:37:49.630 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:37:49.695 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:37:49.701 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:37:49.776 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:37:49.791 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T10:37:49.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:37:49.857 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:37:49.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T10:37:49.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:37:49.992 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:37:49.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T10:37:50.017 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T10:37:50.124 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T10:37:50.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T10:37:50.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:37:50.222 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:37:50.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T10:37:50.239 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:37:50.349 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:37:50.355 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T10:37:50.368 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T10:37:50.473 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T10:37:50.480 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T10:37:50.489 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T10:37:50.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T10:37:50.545 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T10:37:50.563 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T10:37:50.563 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:37:50.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T10:37:50.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:50.584 INFO:tasks.ceph:role: osd.0 2024-04-25T10:37:50.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:37:50.585 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:37:50.646 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:37:50.647 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:37:50.676 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-25T10:37:50.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-25T10:37:50.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T10:37:50.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T10:37:50.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:37:50.809 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:37:50.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T10:37:50.875 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:50.875 INFO:tasks.ceph:role: osd.1 2024-04-25T10:37:50.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:37:50.876 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:37:50.938 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:37:50.939 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:37:50.967 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-25T10:37:50.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-25T10:37:50.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T10:37:51.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T10:37:51.095 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:37:51.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:37:51.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T10:37:51.159 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:51.159 INFO:tasks.ceph:role: osd.2 2024-04-25T10:37:51.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:37:51.159 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:37:51.218 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:37:51.218 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:37:51.219 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:37:51.248 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-25T10:37:51.250 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-25T10:37:51.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T10:37:51.322 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T10:37:51.379 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:37:51.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:37:51.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T10:37:51.447 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:37:51.447 INFO:tasks.ceph:role: osd.3 2024-04-25T10:37:51.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:37:51.447 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:37:51.506 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:37:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:37:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:37:51.506 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:37:51.507 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:37:51.539 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-25T10:37:51.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-25T10:37:51.542 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T10:37:51.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T10:37:51.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:37:51.683 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:37:51.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:51.821 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.818+0000 7fa2cee6b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T10:37:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.818+0000 7fa2cee6b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T10:37:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.818+0000 7fa2cee6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:37:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.818+0000 7fa2cee6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:37:51.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.818+0000 7fa2cee6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:37:51.824 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:51.822+0000 7fa2cee6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T10:37:54.854 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T10:37:54.876 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:54.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.986+0000 7f073b0267c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T10:37:54.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.986+0000 7f073b0267c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T10:37:54.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.986+0000 7f073b0267c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:37:54.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.986+0000 7f073b0267c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:37:54.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.986+0000 7f073b0267c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:37:54.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:54.990+0000 7f073b0267c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T10:37:58.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T10:37:58.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:37:58.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T10:37:58.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T10:37:58.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:37:58.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:37:58.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:37:58.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:37:58.150+0000 7fbd170487c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T10:38:01.213 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T10:38:01.233 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T10:38:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T10:38:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:38:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:38:01.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:38:01.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:01.338+0000 7f1502ab47c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T10:38:04.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T10:38:04.401 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T10:38:04.416 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:38:04.416 INFO:tasks.ceph:role: osd.4 2024-04-25T10:38:04.416 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:38:04.416 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:38:04.480 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:38:04.481 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:38:04.481 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:38:04.481 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:38:04.481 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:38:04.968 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T10:38:04.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T10:38:04.970 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T10:38:05.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T10:38:05.131 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:38:05.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:38:05.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T10:38:05.189 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:38:05.189 INFO:tasks.ceph:role: osd.5 2024-04-25T10:38:05.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:38:05.189 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:38:05.251 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:38:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:38:05.252 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:38:05.702 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T10:38:05.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T10:38:05.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T10:38:05.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T10:38:05.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:38:05.810 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:38:05.811 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T10:38:05.864 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:38:05.864 INFO:tasks.ceph:role: osd.6 2024-04-25T10:38:05.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:38:05.864 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:38:05.927 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:38:06.383 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T10:38:06.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T10:38:06.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T10:38:06.471 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T10:38:06.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:38:06.523 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:38:06.523 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T10:38:06.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:38:06.576 INFO:tasks.ceph:role: osd.7 2024-04-25T10:38:06.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T10:38:06.576 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:38:06.641 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:38:06.642 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:38:06.642 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:38:07.130 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-04-25T10:38:07.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-04-25T10:38:07.133 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T10:38:07.285 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T10:38:07.297 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:38:07.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:38:07.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:07.440 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.435+0000 7fd1b56bb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T10:38:07.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.443+0000 7fd1b56bb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T10:38:07.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.443+0000 7fd1b56bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:38:07.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.443+0000 7fd1b56bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:38:07.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.443+0000 7fd1b56bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:38:07.447 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:07.443+0000 7fd1b56bb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T10:38:10.424 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T10:38:10.438 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:10.550 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T10:38:10.551 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T10:38:10.551 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:38:10.551 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:38:10.551 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:38:10.551 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:10.547+0000 7fc63228e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T10:38:13.532 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T10:38:13.546 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:13.660 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.655+0000 7f31f05a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T10:38:13.661 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.659+0000 7f31f05a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T10:38:13.661 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.659+0000 7f31f05a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:38:13.661 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.659+0000 7f31f05a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:38:13.661 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.659+0000 7f31f05a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:38:13.662 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:13.659+0000 7f31f05a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T10:38:16.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T10:38:16.673 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:16.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T10:38:16.787 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T10:38:16.787 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:38:16.787 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:38:16.787 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:38:16.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:16.782+0000 7feecf2b17c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T10:38:17.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:38:17.409 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:38:19.765 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T10:38:19.778 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T10:38:19.778 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:19.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T10:38:19.801 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:19.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T10:38:19.865 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:19.866 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T10:38:19.929 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:19.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T10:38:19.993 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:19.994 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T10:38:20.057 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:20.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T10:38:20.121 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:20.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T10:38:20.185 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:20.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T10:38:20.253 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.253 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T10:38:20.267 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.267 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T10:38:20.321 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.321 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T10:38:20.378 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.378 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T10:38:20.432 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.432 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T10:38:20.484 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T10:38:20.537 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.537 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T10:38:20.593 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:20.593 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T10:38:20.648 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:20.648 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T10:38:20.658 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T10:38:20.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:38:20.703 DEBUG:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB9MipmnDGFKRAAwwVdqot846MulueQpfAjgQ== 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB9MipmToomMxAAcslss/MrYko862aOc5m0xw== 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB9MipmJAcyOxAA1cxeW3GuwMcT4SM6VId8Lw== 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.e] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB+Mipmbvh2BxAAtlJFbCFXWUxBTFPXuJj44A== 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB/Mipm6YkKMRAAIref6mkrf459ZEgkkwupGw== 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2024-04-25T10:38:20.714 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCCMipmKZAUOxAAquoNzSBDJMSBh90MiLn6bA== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCGMipm0ycnCRAAbyz1brkiK+cGZ3L5mSfw3A== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCJMipmHQZqFBAAZ3zHNUDbtlC2VX2aAl9jFQ== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB9MipmtkdcLhAAYP0YxbsDc7BkBb0FmC3n7w== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB+MipmeJZaDRAANno2xYDRvmftzaKsB8c8kg== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB+Mipmk6HjFBAAmU6vNLW799jiTlYxQd1+eQ== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.f] 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB+Mipm12ZVHBAARpjd2RxdcklRJszZ7FDf7Q== 2024-04-25T10:38:20.715 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCPMipm3uVZGhAAA+iHGHEdPY+RDpax03k41g== 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCSMipmi8biIBAAqEXy9EwlTZrbVSfnCO1Djw== 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCVMipme5tzJxAA9DaU96HtvExkTLtufttM5A== 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCYMipmfmPzLhAADc6H3bvtmhirTZi1R8H7kg== 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2024-04-25T10:38:20.716 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQB+MipmgJqQIBAAJQNNJJdEOI76YwgwBa9A1A== 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9MipmnDGFKRAAwwVdqot846MulueQpfAjgQ== 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9MipmToomMxAAcslss/MrYko862aOc5m0xw== 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2024-04-25T10:38:20.719 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9MipmJAcyOxAA1cxeW3GuwMcT4SM6VId8Lw== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.e] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+Mipmbvh2BxAAtlJFbCFXWUxBTFPXuJj44A== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB/Mipm6YkKMRAAIref6mkrf459ZEgkkwupGw== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCCMipmKZAUOxAAquoNzSBDJMSBh90MiLn6bA== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCGMipm0ycnCRAAbyz1brkiK+cGZ3L5mSfw3A== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCJMipmHQZqFBAAZ3zHNUDbtlC2VX2aAl9jFQ== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB9MipmtkdcLhAAYP0YxbsDc7BkBb0FmC3n7w== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+MipmeJZaDRAANno2xYDRvmftzaKsB8c8kg== 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2024-04-25T10:38:20.720 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+Mipmk6HjFBAAmU6vNLW799jiTlYxQd1+eQ== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.f] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+Mipm12ZVHBAARpjd2RxdcklRJszZ7FDf7Q== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCPMipm3uVZGhAAA+iHGHEdPY+RDpax03k41g== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCSMipmi8biIBAAqEXy9EwlTZrbVSfnCO1Djw== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCVMipme5tzJxAA9DaU96HtvExkTLtufttM5A== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCYMipmfmPzLhAADc6H3bvtmhirTZi1R8H7kg== 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-25T10:38:20.721 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQB+MipmgJqQIBAAJQNNJJdEOI76YwgwBa9A1A== 2024-04-25T10:38:20.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:38:20.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:38:20.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:20.855 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:20.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:20.933 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.008 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.082 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.227 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.295 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.363 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:38:21.367 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:38:21.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.503 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:38:21.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.655 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.721 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.786 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.854 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:38:21.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:38:21.921 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:38:21.986 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T10:38:21.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T10:38:22.007 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:38:22.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T10:38:22.152 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T10:38:22.165 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:38:22.292 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T10:38:22.305 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T10:38:22.359 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:38:22.482 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T10:38:22.492 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:22.495 DEBUG:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:38:22.537 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T10:38:22.538 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T10:38:22.538 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i a 2024-04-25T10:38:22.548 INFO:tasks.ceph.mon.a:Started 2024-04-25T10:38:22.548 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T10:38:22.548 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i b 2024-04-25T10:38:22.584 INFO:tasks.ceph.mon.b:Started 2024-04-25T10:38:22.584 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T10:38:22.584 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mon -f --cluster ceph -i c 2024-04-25T10:38:22.587 INFO:tasks.ceph.mon.c:Started 2024-04-25T10:38:22.587 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T10:38:22.587 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T10:38:22.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-25T10:38:22.591 INFO:tasks.ceph.mgr.y:Started 2024-04-25T10:38:22.591 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T10:38:22.591 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-25T10:38:22.594 INFO:tasks.ceph.mgr.x:Started 2024-04-25T10:38:22.594 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T10:38:22.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T10:38:22.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.745+0000 7face2600640 1 Processor -- start 2024-04-25T10:38:22.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 -- start start 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc15e9e0 con 0x7facdc0ca430 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7facdc15ed10 con 0x7facdc0c5840 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7face2600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0c78a0 con 0x7facdc15f5c0 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45626/0 (socket says 172.21.15.16:45626) 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 learned_addr learned my addr 172.21.15.16:0/469094634 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:22.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:22.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:22.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:22.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:22.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:23.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:23.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:23.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:24.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:24.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:24.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:38:25.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facdc0b37f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facdc0b37f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facdc0c5c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facdc0c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v1:172.21.15.16:6789/0 conn(0x7facdc0ca430 legacy=0x7facdc0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc0c7b80 con 0x7facb4003780 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7facdc15ed10 con 0x7facb40074c0 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:25.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:25.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:25.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:26.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:26.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:26.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:26.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:26.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:26.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:27.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:27.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:27.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:27.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:27.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:27.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 msgr2=0x7facb40099d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb40074c0 0x7facb40099d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v1:172.21.15.186:6789/0 conn(0x7facb4003780 legacy=0x7facb4005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdbe00640 1 -- 172.21.15.16:0/469094634 reap_dead start 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb400b140 con 0x7facb4003780 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7facdc15ed10 con 0x7facdc0c5840 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0c78a0 con 0x7facdc15f5c0 2024-04-25T10:38:28.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:28.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:28.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.749+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:28.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:29.362 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:29.357+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:30.166 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:30.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:30.161+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 msgr2=0x7facb400a1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facdc15f5c0 0x7facb400a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 msgr2=0x7facb400a740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.16:3300/0 conn(0x7facdc0c5840 0x7facb400a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 >> v1:172.21.15.186:6789/0 conn(0x7facb4003780 legacy=0x7facb4005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb400ae30 con 0x7facb40079c0 2024-04-25T10:38:31.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd9600640 1 -- 172.21.15.16:0/469094634 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7facdc15ed10 con 0x7facb4010b90 2024-04-25T10:38:31.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:31.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:31.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:31.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:31.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.753+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:38:31.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.957+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:31.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.957+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:31.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.957+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:31.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.957+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:31.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:31.957+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:38:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.361+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.361+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:38:32.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.361+0000 7facd2a00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:38:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.361+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:38:32.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.361+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504663617 0 0) 0x7facb400ae30 con 0x7facb40079c0 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc0003580 con 0x7facb40079c0 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2100911191 0 0) 0x7facc0003580 con 0x7facb40079c0 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 msgr2=0x7facb4013020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 --2- 172.21.15.16:0/469094634 >> v2:172.21.15.186:3300/0 conn(0x7facb4010b90 0x7facb4013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb4014700 con 0x7facb40079c0 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7faccc00f040 con 0x7facb40079c0 2024-04-25T10:38:32.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 >> v1:172.21.15.16:6789/0 conn(0x7facb40079c0 legacy=0x7facb400f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdbe00640 1 -- 172.21.15.16:0/469094634 reap_dead start 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 0x7facc0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0004860 0x7facc0004c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc00053b0 0x7facc000ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7facdc15ed10 con 0x7facc0003a10 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7facc000c2e0 con 0x7facc0004860 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.949+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7facc000c4e0 con 0x7facc00053b0 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 0x7facc0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdbe00640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc00053b0 0x7facc000ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facd2a00640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0004860 0x7facc0004c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc00053b0 msgr2=0x7facc000ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc00053b0 0x7facc000ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0004860 msgr2=0x7facc0004c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:32.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0004860 0x7facc0004c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 -- 172.21.15.16:0/469094634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc0003580 con 0x7facc0003a10 2024-04-25T10:38:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.953+0000 7facdb400640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 0x7facc0003e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faccc006fd0 tx=0x7faccc01e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a758b6e4c8b58b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b3070 con 0x7facc0003a10 2024-04-25T10:38:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc0ae650 con 0x7facc0003a10 2024-04-25T10:38:32.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7facdaa00640 1 -- 172.21.15.16:0/469094634 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0aa050 con 0x7facc0003a10 2024-04-25T10:38:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 -- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 msgr2=0x7facc0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:32.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 0x7facc0003e60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faccc006fd0 tx=0x7faccc01e5e0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 -- 172.21.15.16:0/469094634 shutdown_connections 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc00053b0 0x7facc000ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0004860 0x7facc0004c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 --2- 172.21.15.16:0/469094634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc0003a10 0x7facc0003e60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 -- 172.21.15.16:0/469094634 >> 172.21.15.16:0/469094634 conn(0x7facdc06ddb0 msgr2=0x7facdc072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 -- 172.21.15.16:0/469094634 shutdown_connections 2024-04-25T10:38:32.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.957+0000 7face2600640 1 -- 172.21.15.16:0/469094634 wait complete. 2024-04-25T10:38:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 Processor -- start 2024-04-25T10:38:32.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 -- start start 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc0004860 0x7facdc1e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc00053b0 0x7facdc0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7facdc0c7540 con 0x7facc00053b0 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7facdc0c8140 con 0x7facc0003a10 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7face2600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7facdc15b3d0 con 0x7facc0004860 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:45462/0 (socket says 172.21.15.16:45462) 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 -- 172.21.15.16:0/1186099338 learned_addr learned my addr 172.21.15.16:0/1186099338 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facd2a00640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc0004860 0x7facdc1e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdbe00640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc00053b0 0x7facdc0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 -- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc0004860 msgr2=0x7facdc1e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc0004860 0x7facdc1e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 -- 172.21.15.16:0/1186099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc00053b0 msgr2=0x7facdc0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc00053b0 0x7facdc0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 -- 172.21.15.16:0/1186099338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc1e8500 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.961+0000 7facdb400640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faccc024b10 tx=0x7facc0005890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0b3040 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc0ae430 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc1f6f90 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0aa040 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc0c2130 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faccc0b9a80 con 0x7facc0003a10 2024-04-25T10:38:32.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faccc0bab70 con 0x7facc0003a10 2024-04-25T10:38:32.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.965+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc1e6fd0 con 0x7facc0003a10 2024-04-25T10:38:32.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:32.969+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7faccc00a1d0 con 0x7facc0003a10 2024-04-25T10:38:33.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.033+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7facdc1e86d0 con 0x7facc0003a10 2024-04-25T10:38:33.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7facd3e00640 1 -- 172.21.15.16:0/1186099338 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faccc0ae5e0 con 0x7facc0003a10 2024-04-25T10:38:33.053 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-25T10:38:33.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 msgr2=0x7facdc0c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faccc024b10 tx=0x7facc0005890 comp rx=0 tx=0).stop 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 shutdown_connections 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facc00053b0 0x7facdc0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7facc0004860 0x7facdc1e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 --2- 172.21.15.16:0/1186099338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facc0003a10 0x7facdc0c48a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 >> 172.21.15.16:0/1186099338 conn(0x7facdc06ddb0 msgr2=0x7facdc15cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 shutdown_connections 2024-04-25T10:38:33.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:33.045+0000 7face2600640 1 -- 172.21.15.16:0/1186099338 wait complete. 2024-04-25T10:38:33.066 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T10:38:33.067 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T10:38:33.067 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:33.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T10:38:33.087 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:33.087 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T10:38:33.148 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:33.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T10:38:33.212 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:38:33.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T10:38:33.263 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:33.261+0000 7f5b05ee9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:38:33.272 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:33.272 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T10:38:33.286 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:33.286 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T10:38:33.320 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:33.317+0000 7f2c2471b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:38:33.341 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:33.341 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T10:38:33.398 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T10:38:33.398 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T10:38:33.453 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new b1ae3adf-694c-4bbc-86d3-dd6282c91ef0 0 2024-04-25T10:38:33.666 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 Processor -- start 2024-04-25T10:38:33.666 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 -- start start 2024-04-25T10:38:33.668 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 0x7f8fa80c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.668 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa80ca430 con 0x7f8fa80c6b50 2024-04-25T10:38:33.668 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa80c4b80 con 0x7f8fa80c9ed0 2024-04-25T10:38:33.668 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8faffac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa80c74b0 con 0x7f8fa8154320 2024-04-25T10:38:33.668 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fad547640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f8fa80c9ed0 0x7f8fa80c7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:55182/0 (socket says 172.21.15.186:55182) 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fad547640 1 -- 172.21.15.186:0/2534798836 learned_addr learned my addr 172.21.15.186:0/2534798836 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fadd48640 1 --2- 172.21.15.186:0/2534798836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 0x7f8fa80c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8facd46640 1 -- 172.21.15.186:0/2534798836 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196146885 0 0) 0x7f8fa80c4b80 con 0x7f8fa80c9ed0 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8facd46640 1 -- 172.21.15.186:0/2534798836 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f940057d0 con 0x7f8fa80c9ed0 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fadd48640 1 -- 172.21.15.186:0/2534798836 >> v1:172.21.15.186:6789/0 conn(0x7f8fa80c9ed0 legacy=0x7f8fa80c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fadd48640 1 -- 172.21.15.186:0/2534798836 >> v1:172.21.15.16:6789/0 conn(0x7f8fa80c6b50 legacy=0x7f8fa80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:33.669 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.665+0000 7f8fadd48640 1 -- 172.21.15.186:0/2534798836 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa80c4e60 con 0x7f8fa8154320 2024-04-25T10:38:33.671 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8fadd48640 1 --2- 172.21.15.186:0/2534798836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 0x7f8fa80c56d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009930 tx=0x7f8fa401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce8f6599169b083 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:33.671 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8facd46640 1 -- 172.21.15.186:0/2534798836 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40aa600 con 0x7f8fa8154320 2024-04-25T10:38:33.671 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8facd46640 1 -- 172.21.15.186:0/2534798836 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa40af070 con 0x7f8fa8154320 2024-04-25T10:38:33.671 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8facd46640 1 -- 172.21.15.186:0/2534798836 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40aaa00 con 0x7f8fa8154320 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 -- 172.21.15.186:0/2534798836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 msgr2=0x7f8fa80c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 --2- 172.21.15.186:0/2534798836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 0x7f8fa80c56d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4009930 tx=0x7f8fa401c5a0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 -- 172.21.15.186:0/2534798836 shutdown_connections 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 --2- 172.21.15.186:0/2534798836 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa8154320 0x7f8fa80c56d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 -- 172.21.15.186:0/2534798836 >> 172.21.15.186:0/2534798836 conn(0x7f8fa806dd80 msgr2=0x7f8fa8072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 -- 172.21.15.186:0/2534798836 shutdown_connections 2024-04-25T10:38:33.672 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.669+0000 7f8faffac640 1 -- 172.21.15.186:0/2534798836 wait complete. 2024-04-25T10:38:33.674 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 Processor -- start 2024-04-25T10:38:33.674 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- start start 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 0x7f8fa81551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa8154320 0x7f8fa814e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa806d000 con 0x7f8fa8154320 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa806ce80 con 0x7f8fa80c9ed0 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa806d180 con 0x7f8fa80c6b50 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fad547640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 0x7f8fa81551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fad547640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 0x7f8fa81551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54136/0 (socket says 172.21.15.186:54136) 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37250/0 (socket says 172.21.15.186:37250) 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fad547640 1 -- 172.21.15.186:0/328466010 learned_addr learned my addr 172.21.15.186:0/328466010 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fae549640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa8154320 0x7f8fa814e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 -- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 msgr2=0x7f8fa81551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 0x7f8fa81551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 -- 172.21.15.186:0/328466010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa8154320 msgr2=0x7f8fa814e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa8154320 0x7f8fa814e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 -- 172.21.15.186:0/328466010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa814af80 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8fadd48640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40ab000 tx=0x7f8fa4019340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40b9070 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa40aade0 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4006e60 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa814b260 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa8155ac0 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fa40c4060 con 0x7f8fa80c6b50 2024-04-25T10:38:33.678 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8fa40c6660 con 0x7f8fa80c6b50 2024-04-25T10:38:33.679 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.673+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa8050750 con 0x7f8fa80c6b50 2024-04-25T10:38:33.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.693+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8fa4016190 con 0x7f8fa80c6b50 2024-04-25T10:38:33.767 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.765+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b1ae3adf-694c-4bbc-86d3-dd6282c91ef0", "id": 0} v 0) -- 0x7f8fa8156760 con 0x7f8fa80c6b50 2024-04-25T10:38:33.774 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8f9e7fc640 1 -- 172.21.15.186:0/328466010 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1ae3adf-694c-4bbc-86d3-dd6282c91ef0", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8fa40c68b0 con 0x7f8fa80c6b50 2024-04-25T10:38:33.775 INFO:teuthology.orchestra.run.smithi186.stdout:0 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 msgr2=0x7f8fa81571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40ab000 tx=0x7f8fa4019340 comp rx=0 tx=0).stop 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 shutdown_connections 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa8154320 0x7f8fa814e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fa80c9ed0 0x7f8fa81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 --2- 172.21.15.186:0/328466010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fa80c6b50 0x7f8fa81571b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 >> 172.21.15.186:0/328466010 conn(0x7f8fa806dd80 msgr2=0x7f8fa8150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 shutdown_connections 2024-04-25T10:38:33.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.773+0000 7f8faffac640 1 -- 172.21.15.186:0/328466010 wait complete. 2024-04-25T10:38:33.779 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:33.777+0000 7f5b05ee9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:38:33.796 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 89a430a8-b787-47ed-9b0c-ad3528357eca 1 2024-04-25T10:38:33.848 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:33.845+0000 7f2c2471b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:38:33.938 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 Processor -- start 2024-04-25T10:38:33.938 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 -- start start 2024-04-25T10:38:33.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f390c15de60 0x7f390c154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f390c0c8bd0 0x7f390c0c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f390c0c4fc0 con 0x7f390c15de60 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f390c06e0d0 con 0x7f390c0c8bd0 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f391285e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f390c154670 con 0x7f390c06d780 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f3910dfb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f390c0c8bd0 0x7f390c0c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f3910dfb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37260/0 (socket says 172.21.15.186:37260) 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f3910dfb640 1 -- 172.21.15.186:0/3521974804 learned_addr learned my addr 172.21.15.186:0/3521974804 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 -- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 msgr2=0x7f390c06db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 -- 172.21.15.186:0/3521974804 >> v2:172.21.15.16:3300/0 conn(0x7f390c15de60 msgr2=0x7f390c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 --2- 172.21.15.186:0/3521974804 >> v2:172.21.15.16:3300/0 conn(0x7f390c15de60 0x7f390c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f390b7fe640 1 -- 172.21.15.186:0/3521974804 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c0c22b0 con 0x7f390c0c8bd0 2024-04-25T10:38:33.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.937+0000 7f3910dfb640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:33.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f390b7fe640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c0c8fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ca3b0 tx=0x7f390001ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=529efbfe3ce96e6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:33.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f390affd640 1 -- 172.21.15.186:0/3521974804 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000b5070 con 0x7f390c0c8bd0 2024-04-25T10:38:33.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f390affd640 1 -- 172.21.15.186:0/3521974804 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39000a8a30 con 0x7f390c0c8bd0 2024-04-25T10:38:33.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f390affd640 1 -- 172.21.15.186:0/3521974804 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000a8e40 con 0x7f390c0c8bd0 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 -- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 msgr2=0x7f390c0c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c0c8fe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ca3b0 tx=0x7f390001ed70 comp rx=0 tx=0).stop 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 -- 172.21.15.186:0/3521974804 shutdown_connections 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c06db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 --2- 172.21.15.186:0/3521974804 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c0c8fe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 --2- 172.21.15.186:0/3521974804 >> v2:172.21.15.16:3300/0 conn(0x7f390c15de60 0x7f390c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 -- 172.21.15.186:0/3521974804 >> 172.21.15.186:0/3521974804 conn(0x7f390c071630 msgr2=0x7f390c071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 -- 172.21.15.186:0/3521974804 shutdown_connections 2024-04-25T10:38:33.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.941+0000 7f391285e640 1 -- 172.21.15.186:0/3521974804 wait complete. 2024-04-25T10:38:33.946 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 Processor -- start 2024-04-25T10:38:33.946 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 -- start start 2024-04-25T10:38:33.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c14b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c15de60 0x7f390c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:33.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0c54d0 con 0x7f390c15de60 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f390c0c51f0 con 0x7f390c0c8bd0 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f391285e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f390c0c83d0 con 0x7f390c06d780 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c14b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54152/0 (socket says 172.21.15.186:54152) 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 -- 172.21.15.186:0/1507332837 learned_addr learned my addr 172.21.15.186:0/1507332837 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f3910dfb640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c15de60 0x7f390c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 -- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 msgr2=0x7f390c14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c14b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 -- 172.21.15.186:0/1507332837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c15de60 msgr2=0x7f390c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c15de60 0x7f390c150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 -- 172.21.15.186:0/1507332837 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c156870 con 0x7f390c0c8bd0 2024-04-25T10:38:33.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.945+0000 7f390b7fe640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39000b3040 tx=0x7f390001bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:33.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000c4070 con 0x7f390c0c8bd0 2024-04-25T10:38:33.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39000b0850 con 0x7f390c0c8bd0 2024-04-25T10:38:33.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900006e60 con 0x7f390c0c8bd0 2024-04-25T10:38:33.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c154950 con 0x7f390c0c8bd0 2024-04-25T10:38:33.952 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c154ed0 con 0x7f390c0c8bd0 2024-04-25T10:38:33.953 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39000b0c40 con 0x7f390c0c8bd0 2024-04-25T10:38:33.953 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f39000c87a0 con 0x7f390c0c8bd0 2024-04-25T10:38:33.953 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.949+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c150a70 con 0x7f390c0c8bd0 2024-04-25T10:38:33.955 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:33.953+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f39000cd020 con 0x7f390c0c8bd0 2024-04-25T10:38:33.964 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:33.961+0000 7f5b05ee9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:38:34.019 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.017+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89a430a8-b787-47ed-9b0c-ad3528357eca", "id": 1} v 0) -- 0x7f390c0009a0 con 0x7f390c0c8bd0 2024-04-25T10:38:34.025 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.021+0000 7f3908ff9640 1 -- 172.21.15.186:0/1507332837 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89a430a8-b787-47ed-9b0c-ad3528357eca", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f39000188d0 con 0x7f390c0c8bd0 2024-04-25T10:38:34.025 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 msgr2=0x7f390c156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f39000b3040 tx=0x7f390001bb10 comp rx=0 tx=0).stop 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 shutdown_connections 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f390c15de60 0x7f390c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f390c0c8bd0 0x7f390c156330 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 --2- 172.21.15.186:0/1507332837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f390c06d780 0x7f390c14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 >> 172.21.15.186:0/1507332837 conn(0x7f390c071630 msgr2=0x7f390c157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 shutdown_connections 2024-04-25T10:38:34.027 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.025+0000 7f391285e640 1 -- 172.21.15.186:0/1507332837 wait complete. 2024-04-25T10:38:34.051 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 5d56f0bb-ded6-4168-ac5a-032df75b7e1a 2 2024-04-25T10:38:34.078 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:34.077+0000 7f2c2471b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:38:34.194 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 Processor -- start 2024-04-25T10:38:34.194 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 -- start start 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb8900c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89015ac50 con 0x7fb89006d780 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb89015a410 con 0x7fb890150880 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb897209640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb89015a6b0 con 0x7fb89015dc10 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb894fa5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb8900c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb894fa5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54164/0 (socket says 172.21.15.186:54164) 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb894fa5640 1 -- 172.21.15.186:0/2424607306 learned_addr learned my addr 172.21.15.186:0/2424607306 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb88ffff640 1 -- 172.21.15.186:0/2424607306 >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 msgr2=0x7fb890159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb88ffff640 1 --2- 172.21.15.186:0/2424607306 >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.197 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb88ffff640 1 -- 172.21.15.186:0/2424607306 >> v1:172.21.15.16:6789/0 conn(0x7fb89006d780 legacy=0x7fb8900c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.198 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb88ffff640 1 -- 172.21.15.186:0/2424607306 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89015a970 con 0x7fb89015dc10 2024-04-25T10:38:34.198 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.193+0000 7fb894fa5640 1 --2- 172.21.15.186:0/2424607306 >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:34.198 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb88ffff640 1 --2- 172.21.15.186:0/2424607306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb8900c5190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb884009900 tx=0x7fb88401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b48ed6d94960491 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.199 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb88f7fe640 1 -- 172.21.15.186:0/2424607306 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840aa610 con 0x7fb89015dc10 2024-04-25T10:38:34.199 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb88f7fe640 1 -- 172.21.15.186:0/2424607306 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8840af070 con 0x7fb89015dc10 2024-04-25T10:38:34.199 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb88f7fe640 1 -- 172.21.15.186:0/2424607306 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840aaa10 con 0x7fb89015dc10 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- 172.21.15.186:0/2424607306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 msgr2=0x7fb8900c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 --2- 172.21.15.186:0/2424607306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb8900c5190 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb884009900 tx=0x7fb88401c5a0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- 172.21.15.186:0/2424607306 shutdown_connections 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 --2- 172.21.15.186:0/2424607306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb8900c5190 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 --2- 172.21.15.186:0/2424607306 >> v2:172.21.15.186:3300/0 conn(0x7fb890150880 0x7fb890159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- 172.21.15.186:0/2424607306 >> 172.21.15.186:0/2424607306 conn(0x7fb8900ca680 msgr2=0x7fb8900caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- 172.21.15.186:0/2424607306 shutdown_connections 2024-04-25T10:38:34.200 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- 172.21.15.186:0/2424607306 wait complete. 2024-04-25T10:38:34.201 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 Processor -- start 2024-04-25T10:38:34.201 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.197+0000 7fb897209640 1 -- start start 2024-04-25T10:38:34.204 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb89006d780 0x7fb89015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.204 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8900c5850 con 0x7fb89006d780 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb8900c56d0 con 0x7fb890150880 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb89015e020 con 0x7fb89015dc10 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37280/0 (socket says 172.21.15.186:37280) 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 -- 172.21.15.186:0/1509050138 learned_addr learned my addr 172.21.15.186:0/1509050138 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54170/0 (socket says 172.21.15.186:54170) 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb894fa5640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb89006d780 0x7fb89015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 -- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 msgr2=0x7fb890140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.205 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 -- 172.21.15.186:0/1509050138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb89006d780 msgr2=0x7fb89015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb89006d780 0x7fb89015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 -- 172.21.15.186:0/1509050138 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89015c2a0 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88ffff640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb8957a6640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c7b0 tx=0x7fb88000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880016020 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb880006d60 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8901f8800 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880003bc0 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901403e0 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb88000abe0 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb880003d60 con 0x7fb89015dc10 2024-04-25T10:38:34.206 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.201+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb890147600 con 0x7fb89015dc10 2024-04-25T10:38:34.207 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.205+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb880020020 con 0x7fb89015dc10 2024-04-25T10:38:34.275 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.273+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5d56f0bb-ded6-4168-ac5a-032df75b7e1a", "id": 2} v 0) -- 0x7fb89006e8d0 con 0x7fb89015dc10 2024-04-25T10:38:34.279 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb88d7fa640 1 -- 172.21.15.186:0/1509050138 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d56f0bb-ded6-4168-ac5a-032df75b7e1a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb8800050d0 con 0x7fb89015dc10 2024-04-25T10:38:34.280 INFO:teuthology.orchestra.run.smithi186.stdout:2 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 msgr2=0x7fb890140f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb88000c7b0 tx=0x7fb88000cc70 comp rx=0 tx=0).stop 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 shutdown_connections 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb89015dc10 0x7fb890140f50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb890150880 0x7fb890140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 --2- 172.21.15.186:0/1509050138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb89006d780 0x7fb89015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 >> 172.21.15.186:0/1509050138 conn(0x7fb8900ca680 msgr2=0x7fb890143170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 shutdown_connections 2024-04-25T10:38:34.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.277+0000 7fb897209640 1 -- 172.21.15.186:0/1509050138 wait complete. 2024-04-25T10:38:34.298 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new c3ec0e48-5a10-45d0-9c32-dc0f523ce71b 3 2024-04-25T10:38:34.438 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 Processor -- start 2024-04-25T10:38:34.438 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 -- start start 2024-04-25T10:38:34.440 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 0x7f290c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f290c0c88f0 con 0x7f290c0c4e30 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f290c0c72c0 con 0x7f290c06d8a0 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f291306d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f290c15a840 con 0x7f290c153f90 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f2910e09640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 0x7f290c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f290bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f290bfff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54174/0 (socket says 172.21.15.186:54174) 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f290bfff640 1 -- 172.21.15.186:0/731785061 learned_addr learned my addr 172.21.15.186:0/731785061 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f2910e09640 1 -- 172.21.15.186:0/731785061 >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 msgr2=0x7f290c0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f2910e09640 1 --2- 172.21.15.186:0/731785061 >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f2910e09640 1 -- 172.21.15.186:0/731785061 >> v1:172.21.15.16:6789/0 conn(0x7f290c0c4e30 legacy=0x7f290c0c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f2910e09640 1 -- 172.21.15.186:0/731785061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c15aae0 con 0x7f290c153f90 2024-04-25T10:38:34.441 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.437+0000 7f290bfff640 1 --2- 172.21.15.186:0/731785061 >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:34.443 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f2910e09640 1 --2- 172.21.15.186:0/731785061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 0x7f290c0c7750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009900 tx=0x7f28fc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3760b9f7011fe280 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.443 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f290b7fe640 1 -- 172.21.15.186:0/731785061 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0b2070 con 0x7f290c153f90 2024-04-25T10:38:34.443 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f290b7fe640 1 -- 172.21.15.186:0/731785061 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28fc0ad680 con 0x7f290c153f90 2024-04-25T10:38:34.443 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f290b7fe640 1 -- 172.21.15.186:0/731785061 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0ada50 con 0x7f290c153f90 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 -- 172.21.15.186:0/731785061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 msgr2=0x7f290c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 --2- 172.21.15.186:0/731785061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 0x7f290c0c7750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009900 tx=0x7f28fc01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 -- 172.21.15.186:0/731785061 shutdown_connections 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 --2- 172.21.15.186:0/731785061 >> v2:172.21.15.186:3300/0 conn(0x7f290c06d8a0 0x7f290c0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 --2- 172.21.15.186:0/731785061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c153f90 0x7f290c0c7750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 -- 172.21.15.186:0/731785061 >> 172.21.15.186:0/731785061 conn(0x7f290c0ca680 msgr2=0x7f290c0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 -- 172.21.15.186:0/731785061 shutdown_connections 2024-04-25T10:38:34.444 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.441+0000 7f291306d640 1 -- 172.21.15.186:0/731785061 wait complete. 2024-04-25T10:38:34.445 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 Processor -- start 2024-04-25T10:38:34.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- start start 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 0x7f290c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 0x7f290c162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f290c0b9880 con 0x7f290c06d8a0 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f290c0c6f50 con 0x7f290c153f90 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f290c164f50 con 0x7f290c0c4e30 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37296/0 (socket says 172.21.15.186:37296) 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 -- 172.21.15.186:0/3184199641 learned_addr learned my addr 172.21.15.186:0/3184199641 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291160a640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 0x7f290c162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f2910e09640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 0x7f290c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.449 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 -- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 msgr2=0x7f290c162d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 0x7f290c162d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 -- 172.21.15.186:0/3184199641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 msgr2=0x7f290c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 0x7f290c156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 -- 172.21.15.186:0/3184199641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c1fbc80 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291160a640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 0x7f290c162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f2910e09640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 0x7f290c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f290bfff640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28f400ec10 tx=0x7f28f400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4017070 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f400cbd0 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4013470 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290c1fbf60 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f290c1fc520 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f28f401a070 con 0x7f290c0c4e30 2024-04-25T10:38:34.450 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f28f401ca60 con 0x7f290c0c4e30 2024-04-25T10:38:34.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.445+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290c050750 con 0x7f290c0c4e30 2024-04-25T10:38:34.451 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.449+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f28f401ccf0 con 0x7f290c0c4e30 2024-04-25T10:38:34.518 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.517+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c3ec0e48-5a10-45d0-9c32-dc0f523ce71b", "id": 3} v 0) -- 0x7f290c152ac0 con 0x7f290c0c4e30 2024-04-25T10:38:34.526 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f29097fa640 1 -- 172.21.15.186:0/3184199641 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3ec0e48-5a10-45d0-9c32-dc0f523ce71b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f28f401c590 con 0x7f290c0c4e30 2024-04-25T10:38:34.526 INFO:teuthology.orchestra.run.smithi186.stdout:3 2024-04-25T10:38:34.527 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 msgr2=0x7f290c14e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.527 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f28f400ec10 tx=0x7f28f400c520 comp rx=0 tx=0).stop 2024-04-25T10:38:34.527 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 shutdown_connections 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f290c153f90 0x7f290c162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f290c0c4e30 0x7f290c14e2d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 --2- 172.21.15.186:0/3184199641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f290c06d8a0 0x7f290c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 >> 172.21.15.186:0/3184199641 conn(0x7f290c0ca680 msgr2=0x7f290c1532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 shutdown_connections 2024-04-25T10:38:34.528 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.525+0000 7f291306d640 1 -- 172.21.15.186:0/3184199641 wait complete. 2024-04-25T10:38:34.545 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new aab30584-3e43-46b7-99f0-08a0e21d509f 4 2024-04-25T10:38:34.551 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.549+0000 7f5b05ee9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:38:34.607 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.605+0000 7f5b05ee9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:38:34.663 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.661+0000 7f5b05ee9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:38:34.685 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.681+0000 7ff5fb061640 1 Processor -- start 2024-04-25T10:38:34.685 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.681+0000 7ff5fb061640 1 -- start start 2024-04-25T10:38:34.687 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5fb061640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5f4154320 0x7ff5f40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5fb061640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5f40c9ed0 0x7ff5f40c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5fb061640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f40ca430 con 0x7ff5f40c6b50 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5fb061640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f40c74b0 con 0x7ff5f40c9ed0 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5fb061640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f40c4b80 con 0x7ff5f4154320 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5f4154320 0x7ff5f40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5f4154320 0x7ff5f40c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54196/0 (socket says 172.21.15.186:54196) 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/3887116525 learned_addr learned my addr 172.21.15.186:0/3887116525 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f3fff640 1 --2- 172.21.15.186:0/3887116525 >> v2:172.21.15.16:3300/0 conn(0x7ff5f40c9ed0 0x7ff5f40c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/3887116525 >> v2:172.21.15.16:3300/0 conn(0x7ff5f40c9ed0 msgr2=0x7ff5f40c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 --2- 172.21.15.186:0/3887116525 >> v2:172.21.15.16:3300/0 conn(0x7ff5f40c9ed0 0x7ff5f40c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/3887116525 >> v1:172.21.15.186:6789/0 conn(0x7ff5f40c6b50 legacy=0x7ff5f40cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.688 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/3887116525 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f40c4e60 con 0x7ff5f4154320 2024-04-25T10:38:34.689 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f8dfd640 1 --2- 172.21.15.186:0/3887116525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f4154320 0x7ff5f40c56d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40cf3d0 tx=0x7ff5e001ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e7d975f74df1f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.689 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f37fe640 1 -- 172.21.15.186:0/3887116525 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b5070 con 0x7ff5f4154320 2024-04-25T10:38:34.689 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f37fe640 1 -- 172.21.15.186:0/3887116525 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e00a8b30 con 0x7ff5f4154320 2024-04-25T10:38:34.689 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.685+0000 7ff5f37fe640 1 -- 172.21.15.186:0/3887116525 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b0440 con 0x7ff5f4154320 2024-04-25T10:38:34.690 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- 172.21.15.186:0/3887116525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f4154320 msgr2=0x7ff5f40c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 --2- 172.21.15.186:0/3887116525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f4154320 0x7ff5f40c56d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff5f40cf3d0 tx=0x7ff5e001ee30 comp rx=0 tx=0).stop 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- 172.21.15.186:0/3887116525 shutdown_connections 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 --2- 172.21.15.186:0/3887116525 >> v2:172.21.15.16:3300/0 conn(0x7ff5f40c9ed0 0x7ff5f40c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 --2- 172.21.15.186:0/3887116525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f4154320 0x7ff5f40c56d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- 172.21.15.186:0/3887116525 >> 172.21.15.186:0/3887116525 conn(0x7ff5f406dd80 msgr2=0x7ff5f4072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- 172.21.15.186:0/3887116525 shutdown_connections 2024-04-25T10:38:34.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- 172.21.15.186:0/3887116525 wait complete. 2024-04-25T10:38:34.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 Processor -- start 2024-04-25T10:38:34.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.689+0000 7ff5fb061640 1 -- start start 2024-04-25T10:38:34.695 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.695 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 0x7ff5f414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5f4154320 0x7ff5f41f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f40c7e80 con 0x7ff5f40c9ed0 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f40c7140 con 0x7ff5f40c6b50 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f40cb360 con 0x7ff5f4154320 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54208/0 (socket says 172.21.15.186:54208) 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/2084357061 learned_addr learned my addr 172.21.15.186:0/2084357061 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f95fe640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5f4154320 0x7ff5f41f9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f3fff640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 0x7ff5f414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5f4154320 msgr2=0x7ff5f41f9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5f4154320 0x7ff5f41f9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/2084357061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 msgr2=0x7ff5f414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 0x7ff5f414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 -- 172.21.15.186:0/2084357061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f414d6a0 con 0x7ff5f40c6b50 2024-04-25T10:38:34.696 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f3fff640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 0x7ff5f414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f8dfd640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b3040 tx=0x7ff5e001bbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b5040 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e00be070 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00b9420 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f414f1a0 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f414c680 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff5e00b9680 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff5e00c3a00 con 0x7ff5f40c6b50 2024-04-25T10:38:34.697 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.693+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f4050750 con 0x7ff5f40c6b50 2024-04-25T10:38:34.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.697+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff5e0018990 con 0x7ff5f40c6b50 2024-04-25T10:38:34.720 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:34.717+0000 7f2c2471b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:38:34.745 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.741+0000 7f5b05ee9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:38:34.765 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.761+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aab30584-3e43-46b7-99f0-08a0e21d509f", "id": 4} v 0) -- 0x7ff5f414f790 con 0x7ff5f40c6b50 2024-04-25T10:38:34.770 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5f17fa640 1 -- 172.21.15.186:0/2084357061 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aab30584-3e43-46b7-99f0-08a0e21d509f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff5e00b9b00 con 0x7ff5f40c6b50 2024-04-25T10:38:34.770 INFO:teuthology.orchestra.run.smithi186.stdout:4 2024-04-25T10:38:34.771 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 msgr2=0x7ff5f414b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.771 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00b3040 tx=0x7ff5e001bbd0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.771 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 shutdown_connections 2024-04-25T10:38:34.771 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5f4154320 0x7ff5f41f9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.772 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5f40c9ed0 0x7ff5f414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.772 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 --2- 172.21.15.186:0/2084357061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5f40c6b50 0x7ff5f414b9b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.772 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 >> 172.21.15.186:0/2084357061 conn(0x7ff5f406dd80 msgr2=0x7ff5f40c8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.772 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 shutdown_connections 2024-04-25T10:38:34.772 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.769+0000 7ff5fb061640 1 -- 172.21.15.186:0/2084357061 wait complete. 2024-04-25T10:38:34.786 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:34.785+0000 7f2c2471b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:38:34.789 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new a770ed96-5340-4c4e-97bc-f72012ab06af 5 2024-04-25T10:38:34.801 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.797+0000 7f5b05ee9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:38:34.850 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:34.849+0000 7f2c2471b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:38:34.881 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.877+0000 7f5b05ee9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:38:34.936 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.933+0000 7f01abc56640 1 Processor -- start 2024-04-25T10:38:34.937 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.933+0000 7f01abc56640 1 -- start start 2024-04-25T10:38:34.937 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:34.933+0000 7f5b05ee9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:38:34.939 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.939 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01a40cab70 0x7f01a40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.939 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.939 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f01a40c5200 con 0x7f01a40cab70 2024-04-25T10:38:34.939 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f01a40c9df0 con 0x7f01a4159e60 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01abc56640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f01a40ca720 con 0x7f01a40c56d0 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01aa1f3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01aa1f3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54214/0 (socket says 172.21.15.186:54214) 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37316/0 (socket says 172.21.15.186:37316) 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01aa1f3640 1 -- 172.21.15.186:0/1272085556 learned_addr learned my addr 172.21.15.186:0/1272085556 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a91f1640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.16:3300/0 conn(0x7f01a40cab70 0x7f01a40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 -- 172.21.15.186:0/1272085556 >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 msgr2=0x7f01a415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 -- 172.21.15.186:0/1272085556 >> v2:172.21.15.16:3300/0 conn(0x7f01a40cab70 msgr2=0x7f01a40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.16:3300/0 conn(0x7f01a40cab70 0x7f01a40caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 -- 172.21.15.186:0/1272085556 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a415e140 con 0x7f01a40c56d0 2024-04-25T10:38:34.940 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01aa1f3640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:34.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a99f2640 1 --2- 172.21.15.186:0/1272085556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01a40c2800 tx=0x7f01a001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d0a187c6f7525b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a89f0640 1 -- 172.21.15.186:0/1272085556 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a00ab430 con 0x7f01a40c56d0 2024-04-25T10:38:34.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a89f0640 1 -- 172.21.15.186:0/1272085556 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00b0070 con 0x7f01a40c56d0 2024-04-25T10:38:34.941 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.937+0000 7f01a89f0640 1 -- 172.21.15.186:0/1272085556 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a00ab830 con 0x7f01a40c56d0 2024-04-25T10:38:34.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- 172.21.15.186:0/1272085556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 msgr2=0x7f01a40c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- 172.21.15.186:0/1272085556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01a40c2800 tx=0x7f01a001c580 comp rx=0 tx=0).stop 2024-04-25T10:38:34.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- 172.21.15.186:0/1272085556 shutdown_connections 2024-04-25T10:38:34.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.186:3300/0 conn(0x7f01a4159e60 0x7f01a415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- 172.21.15.186:0/1272085556 >> v2:172.21.15.16:3300/0 conn(0x7f01a40cab70 0x7f01a40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- 172.21.15.186:0/1272085556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a40c94f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- 172.21.15.186:0/1272085556 >> 172.21.15.186:0/1272085556 conn(0x7f01a406dd80 msgr2=0x7f01a4072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:34.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- 172.21.15.186:0/1272085556 shutdown_connections 2024-04-25T10:38:34.943 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- 172.21.15.186:0/1272085556 wait complete. 2024-04-25T10:38:34.944 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:34.941+0000 7f2c2471b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:38:34.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 Processor -- start 2024-04-25T10:38:34.944 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- start start 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01a40cab70 0x7f01a40bc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 0x7f01a40be310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f01a40ca320 con 0x7f01a4159e60 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f01a40c5ae0 con 0x7f01a40cab70 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01abc56640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f01a415dde0 con 0x7f01a40c56d0 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37330/0 (socket says 172.21.15.186:37330) 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 -- 172.21.15.186:0/143770072 learned_addr learned my addr 172.21.15.186:0/143770072 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:34.947 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a91f1640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01a40cab70 0x7f01a40bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01aa1f3640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 0x7f01a40be310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 -- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01a40cab70 msgr2=0x7f01a40bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01a40cab70 0x7f01a40bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 -- 172.21.15.186:0/143770072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 msgr2=0x7f01a40be310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.941+0000 7f01a99f2640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 0x7f01a40be310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01a99f2640 1 -- 172.21.15.186:0/143770072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a40bca60 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01aa1f3640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 0x7f01a40be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01a99f2640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01a00ad040 tx=0x7f01a0019320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0006e60 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a00bd070 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a00b45f0 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a40be030 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a4149780 con 0x7f01a40c56d0 2024-04-25T10:38:34.948 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01a00b4790 con 0x7f01a40c56d0 2024-04-25T10:38:34.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f01a00c2aa0 con 0x7f01a40c56d0 2024-04-25T10:38:34.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a41499c0 con 0x7f01a40c56d0 2024-04-25T10:38:34.949 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:34.945+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f01a0016170 con 0x7f01a40c56d0 2024-04-25T10:38:35.008 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:35.005+0000 7f2c2471b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:38:35.013 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.009+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a770ed96-5340-4c4e-97bc-f72012ab06af", "id": 5} v 0) -- 0x7f01a4153bf0 con 0x7f01a40c56d0 2024-04-25T10:38:35.018 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f019a7fc640 1 -- 172.21.15.186:0/143770072 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a770ed96-5340-4c4e-97bc-f72012ab06af", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f01a4153bf0 con 0x7f01a40c56d0 2024-04-25T10:38:35.019 INFO:teuthology.orchestra.run.smithi186.stdout:5 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 msgr2=0x7f01a414eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f01a00ad040 tx=0x7f01a0019320 comp rx=0 tx=0).stop 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 shutdown_connections 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01a4159e60 0x7f01a40be310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01a40cab70 0x7f01a40bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 --2- 172.21.15.186:0/143770072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01a40c56d0 0x7f01a414eb80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 >> 172.21.15.186:0/143770072 conn(0x7f01a406dd80 msgr2=0x7f01a40c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 shutdown_connections 2024-04-25T10:38:35.020 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.017+0000 7f01abc56640 1 -- 172.21.15.186:0/143770072 wait complete. 2024-04-25T10:38:35.037 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new d9de2d31-45f2-46af-aba8-be8a200431bf 6 2024-04-25T10:38:35.094 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:35.093+0000 7f5b05ee9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:38:35.102 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:35.101+0000 7f2c2471b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:38:35.158 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:35.157+0000 7f5b05ee9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:38:35.168 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:35.165+0000 7f2c2471b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:38:35.172 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.169+0000 7f61f37bb640 1 Processor -- start 2024-04-25T10:38:35.172 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.169+0000 7f61f37bb640 1 -- start start 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f61ec0cab70 0x7f61ec0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f61ec162730 0x7f61ec164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61ec0ca720 con 0x7f61ec0c56d0 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f61ec0c5200 con 0x7f61ec0cab70 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f61ec0c9df0 con 0x7f61ec162730 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f61ec162730 0x7f61ec164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f61ec162730 0x7f61ec164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54224/0 (socket says 172.21.15.186:54224) 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 -- 172.21.15.186:0/1331373567 learned_addr learned my addr 172.21.15.186:0/1331373567 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f0d56640 1 --2- 172.21.15.186:0/1331373567 >> v2:172.21.15.16:3300/0 conn(0x7f61ec0cab70 0x7f61ec0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 -- 172.21.15.186:0/1331373567 >> v2:172.21.15.16:3300/0 conn(0x7f61ec0cab70 msgr2=0x7f61ec0caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:35.175 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 --2- 172.21.15.186:0/1331373567 >> v2:172.21.15.16:3300/0 conn(0x7f61ec0cab70 0x7f61ec0caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.176 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 -- 172.21.15.186:0/1331373567 >> v1:172.21.15.16:6789/0 conn(0x7f61ec0c56d0 legacy=0x7f61ec0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.176 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 -- 172.21.15.186:0/1331373567 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec15e140 con 0x7f61ec162730 2024-04-25T10:38:35.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f1d58640 1 --2- 172.21.15.186:0/1331373567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec162730 0x7f61ec164b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0c8550 tx=0x7f61e401caf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982f6b8041ba3c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61e3fff640 1 -- 172.21.15.186:0/1331373567 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e40a57c0 con 0x7f61ec162730 2024-04-25T10:38:35.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61e3fff640 1 -- 172.21.15.186:0/1331373567 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e40a5960 con 0x7f61ec162730 2024-04-25T10:38:35.177 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61e3fff640 1 -- 172.21.15.186:0/1331373567 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e40a5d70 con 0x7f61ec162730 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 -- 172.21.15.186:0/1331373567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec162730 msgr2=0x7f61ec164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.173+0000 7f61f37bb640 1 --2- 172.21.15.186:0/1331373567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec162730 0x7f61ec164b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0c8550 tx=0x7f61e401caf0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- 172.21.15.186:0/1331373567 shutdown_connections 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 --2- 172.21.15.186:0/1331373567 >> v2:172.21.15.16:3300/0 conn(0x7f61ec0cab70 0x7f61ec0caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 --2- 172.21.15.186:0/1331373567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec162730 0x7f61ec164b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- 172.21.15.186:0/1331373567 >> 172.21.15.186:0/1331373567 conn(0x7f61ec06dd80 msgr2=0x7f61ec072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- 172.21.15.186:0/1331373567 shutdown_connections 2024-04-25T10:38:35.178 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- 172.21.15.186:0/1331373567 wait complete. 2024-04-25T10:38:35.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 Processor -- start 2024-04-25T10:38:35.179 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- start start 2024-04-25T10:38:35.182 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 0x7f61ec1fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 0x7f61ec15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0ca320 con 0x7f61ec162730 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0c5ae0 con 0x7f61ec0c56d0 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f37bb640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f61ec15dde0 con 0x7f61ec0cab70 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54238/0 (socket says 172.21.15.186:54238) 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 -- 172.21.15.186:0/123635282 learned_addr learned my addr 172.21.15.186:0/123635282 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f0d56640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 0x7f61ec1fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1d58640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 0x7f61ec15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 -- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 msgr2=0x7f61ec1fa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 0x7f61ec1fa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 -- 172.21.15.186:0/123635282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 msgr2=0x7f61ec15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 0x7f61ec15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1557640 1 -- 172.21.15.186:0/123635282 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec1fa900 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f1d58640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 0x7f61ec15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.177+0000 7f61f0d56640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 0x7f61ec1fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61f1557640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c4f0 tx=0x7f61e800c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8016020 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e80052f0 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec1fa6f0 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8007260 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec14d820 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61e80067e0 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f61e8012d50 con 0x7f61ec0c56d0 2024-04-25T10:38:35.184 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ec050750 con 0x7f61ec0c56d0 2024-04-25T10:38:35.185 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.181+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f61e8020020 con 0x7f61ec0c56d0 2024-04-25T10:38:35.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.249+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9de2d31-45f2-46af-aba8-be8a200431bf", "id": 6} v 0) -- 0x7f61ec0c1310 con 0x7f61ec0c56d0 2024-04-25T10:38:35.258 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61e1ffb640 1 -- 172.21.15.186:0/123635282 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9de2d31-45f2-46af-aba8-be8a200431bf", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f61ec1fa900 con 0x7f61ec0c56d0 2024-04-25T10:38:35.258 INFO:teuthology.orchestra.run.smithi186.stdout:6 2024-04-25T10:38:35.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 msgr2=0x7f61ec14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f61e800c4f0 tx=0x7f61e800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 shutdown_connections 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61ec162730 0x7f61ec15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61ec0cab70 0x7f61ec1fa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 --2- 172.21.15.186:0/123635282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61ec0c56d0 0x7f61ec14b230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 >> 172.21.15.186:0/123635282 conn(0x7f61ec06dd80 msgr2=0x7f61ec0bfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 shutdown_connections 2024-04-25T10:38:35.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.257+0000 7f61f37bb640 1 -- 172.21.15.186:0/123635282 wait complete. 2024-04-25T10:38:35.278 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new a5e194aa-e4d2-4888-8c5b-0f9696919c3b 7 2024-04-25T10:38:35.343 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:35.341+0000 7f2c2471b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:38:35.413 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.409+0000 7f1cc3a1c640 1 Processor -- start 2024-04-25T10:38:35.413 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.409+0000 7f1cc3a1c640 1 -- start start 2024-04-25T10:38:35.415 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc3a1c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.415 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc3a1c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 0x7f1cbc15a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.415 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc3a1c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cbc0ca720 con 0x7f1cbc0cab70 2024-04-25T10:38:35.415 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc3a1c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc0c5200 con 0x7f1cbc0caf80 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc3a1c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f1cbc0c9df0 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54254/0 (socket says 172.21.15.186:54254) 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 -- 172.21.15.186:0/1482878455 learned_addr learned my addr 172.21.15.186:0/1482878455 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 -- 172.21.15.186:0/1482878455 >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 msgr2=0x7f1cbc15a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc1fb9640 1 --2- 172.21.15.186:0/1482878455 >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 0x7f1cbc15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 --2- 172.21.15.186:0/1482878455 >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 0x7f1cbc15a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 -- 172.21.15.186:0/1482878455 >> v1:172.21.15.186:6789/0 conn(0x7f1cbc0cab70 legacy=0x7f1cbc159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1caffff640 1 -- 172.21.15.186:0/1482878455 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954533509 0 0) 0x7f1cbc0ca720 con 0x7f1cbc0cab70 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 -- 172.21.15.186:0/1482878455 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc15e140 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.416 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc1fb9640 1 --2- 172.21.15.186:0/1482878455 >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 0x7f1cbc15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:38:35.417 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1cc17b8640 1 --2- 172.21.15.186:0/1482878455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc06e6f0 tx=0x7f1cb801ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec10392789f38032 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.417 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1caffff640 1 -- 172.21.15.186:0/1482878455 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80b5070 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.417 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1caffff640 1 -- 172.21.15.186:0/1482878455 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb80a8b30 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.417 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.413+0000 7f1caffff640 1 -- 172.21.15.186:0/1482878455 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80b0440 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.418 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:35.417+0000 7f2c2471b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/1482878455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 msgr2=0x7f1cbc0c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/1482878455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc06e6f0 tx=0x7f1cb801ee30 comp rx=0 tx=0).stop 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/1482878455 shutdown_connections 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/1482878455 >> v2:172.21.15.16:3300/0 conn(0x7f1cbc0caf80 0x7f1cbc15a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/1482878455 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc0c94f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/1482878455 >> 172.21.15.186:0/1482878455 conn(0x7f1cbc06dd80 msgr2=0x7f1cbc072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/1482878455 shutdown_connections 2024-04-25T10:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.417+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/1482878455 wait complete. 2024-04-25T10:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 Processor -- start 2024-04-25T10:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 -- start start 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 0x7f1cbc0c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 0x7f1cbc0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc0c8fd0 con 0x7f1cbc0caf80 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc0c8cf0 con 0x7f1cbc0c56d0 2024-04-25T10:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc3a1c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1cbc0cb390 con 0x7f1cbc0cab70 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc17b8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc17b8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:54258/0 (socket says 172.21.15.186:54258) 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc0fb7640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 0x7f1cbc0c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.421+0000 7f1cc17b8640 1 -- 172.21.15.186:0/2122404197 learned_addr learned my addr 172.21.15.186:0/2122404197 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc1fb9640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 0x7f1cbc0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 -- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 msgr2=0x7f1cbc156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 -- 172.21.15.186:0/2122404197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 msgr2=0x7f1cbc0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 0x7f1cbc0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 -- 172.21.15.186:0/2122404197 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc0c2db0 con 0x7f1cbc0cab70 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc17b8640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc1fb9640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 0x7f1cbc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc0fb7640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 0x7f1cbc0c2870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c460 tx=0x7f1cb000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0017070 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb0005480 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc0c37d0 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0003840 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc1f8b10 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cb001a070 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f1cb0012a60 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc050750 con 0x7f1cbc0cab70 2024-04-25T10:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.425+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1cb0021020 con 0x7f1cbc0cab70 2024-04-25T10:38:35.537 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.533+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a5e194aa-e4d2-4888-8c5b-0f9696919c3b", "id": 7} v 0) -- 0x7f1cbc0c39e0 con 0x7f1cbc0cab70 2024-04-25T10:38:35.544 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.541+0000 7f1cadffb640 1 -- 172.21.15.186:0/2122404197 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a5e194aa-e4d2-4888-8c5b-0f9696919c3b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f1cb001c570 con 0x7f1cbc0cab70 2024-04-25T10:38:35.544 INFO:teuthology.orchestra.run.smithi186.stdout:7 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 msgr2=0x7f1cbc0c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 0x7f1cbc0c2870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000c460 tx=0x7f1cb000c920 comp rx=0 tx=0).stop 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 shutdown_connections 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cbc0caf80 0x7f1cbc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cbc0cab70 0x7f1cbc0c2870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 --2- 172.21.15.186:0/2122404197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cbc0c56d0 0x7f1cbc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 >> 172.21.15.186:0/2122404197 conn(0x7f1cbc06dd80 msgr2=0x7f1cbc151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.547 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 shutdown_connections 2024-04-25T10:38:35.548 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T10:38:35.545+0000 7f1cc3a1c640 1 -- 172.21.15.186:0/2122404197 wait complete. 2024-04-25T10:38:35.564 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T10:38:35.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-25T10:38:35.567 INFO:tasks.ceph.osd.0:Started 2024-04-25T10:38:35.568 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T10:38:35.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-25T10:38:35.571 INFO:tasks.ceph.osd.1:Started 2024-04-25T10:38:35.571 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T10:38:35.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-25T10:38:35.574 INFO:tasks.ceph.osd.2:Started 2024-04-25T10:38:35.574 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T10:38:35.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-25T10:38:35.577 INFO:tasks.ceph.osd.3:Started 2024-04-25T10:38:35.577 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T10:38:35.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-25T10:38:35.579 INFO:tasks.ceph.osd.4:Started 2024-04-25T10:38:35.579 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T10:38:35.580 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-25T10:38:35.581 INFO:tasks.ceph.osd.5:Started 2024-04-25T10:38:35.581 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T10:38:35.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-25T10:38:35.583 INFO:tasks.ceph.osd.6:Started 2024-04-25T10:38:35.583 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T10:38:35.583 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-25T10:38:35.585 INFO:tasks.ceph.osd.7:Started 2024-04-25T10:38:35.585 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:35.783 INFO:tasks.ceph.mgr.x.smithi186.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T10:38:35.783 INFO:tasks.ceph.mgr.x.smithi186.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T10:38:35.783 INFO:tasks.ceph.mgr.x.smithi186.stderr: from numpy import show_config as show_numpy_config 2024-04-25T10:38:35.819 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:35.817+0000 7f5b05ee9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:38:35.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 Processor -- start 2024-04-25T10:38:35.822 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 -- start start 2024-04-25T10:38:35.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ad815a640 0x7f6ad80c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80cb100 0x7f6ad806d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad815db10 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.825 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad815d250 con 0x7f6ad815a640 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ade600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad80c9240 con 0x7f6ad80cb100 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ad7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ad7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35434/0 (socket says 172.21.15.16:35434) 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3604565365 learned_addr learned my addr 172.21.15.16:0/3604565365 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.821+0000 7f6add200640 1 --2- 172.21.15.16:0/3604565365 >> v2:172.21.15.186:3300/0 conn(0x7f6ad815a640 0x7f6ad80c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6addc00640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80cb100 0x7f6ad806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3604565365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80cb100 msgr2=0x7f6ad806d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80cb100 0x7f6ad806d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3604565365 >> v2:172.21.15.186:3300/0 conn(0x7f6ad815a640 msgr2=0x7f6ad80c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3604565365 >> v2:172.21.15.186:3300/0 conn(0x7f6ad815a640 0x7f6ad80c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3604565365 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad80c94e0 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80c96b0 tx=0x7f6ac401ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c0eabec3e5041b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7400640 1 -- 172.21.15.16:0/3604565365 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40a8af0 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7400640 1 -- 172.21.15.16:0/3604565365 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac40a8c90 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.825+0000 7f6ad7400640 1 -- 172.21.15.16:0/3604565365 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40b0660 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- 172.21.15.16:0/3604565365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80ca7b0 msgr2=0x7f6ad80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ad80c96b0 tx=0x7f6ac401ee30 comp rx=0 tx=0).stop 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- 172.21.15.16:0/3604565365 shutdown_connections 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80cb100 0x7f6ad806d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 --2- 172.21.15.16:0/3604565365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80ca7b0 0x7f6ad80cabc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 --2- 172.21.15.16:0/3604565365 >> v2:172.21.15.186:3300/0 conn(0x7f6ad815a640 0x7f6ad80c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- 172.21.15.16:0/3604565365 >> 172.21.15.16:0/3604565365 conn(0x7f6ad8071ef0 msgr2=0x7f6ad8072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- 172.21.15.16:0/3604565365 shutdown_connections 2024-04-25T10:38:35.830 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- 172.21.15.16:0/3604565365 wait complete. 2024-04-25T10:38:35.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 Processor -- start 2024-04-25T10:38:35.832 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.829+0000 7f6ade600640 1 -- start start 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 0x7f6ad81f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ad815a640 0x7f6ad8154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad815aa50 con 0x7f6ad80cb100 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad815d7a0 con 0x7f6ad815a640 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad80c9780 con 0x7f6ad80ca7b0 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35444/0 (socket says 172.21.15.16:35444) 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3660697899 learned_addr learned my addr 172.21.15.16:0/3660697899 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6add200640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 0x7f6ad81f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6addc00640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ad815a640 0x7f6ad8154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 msgr2=0x7f6ad81f84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 0x7f6ad81f84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ad815a640 msgr2=0x7f6ad8154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ad815a640 0x7f6ad8154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 -- 172.21.15.16:0/3660697899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad81f8a10 con 0x7f6ad80cb100 2024-04-25T10:38:35.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6add200640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 0x7f6ad81f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad7e00640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ac401f6d0 tx=0x7f6ac401bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40a8af0 con 0x7f6ad80cb100 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac40c0070 con 0x7f6ad80cb100 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad8157340 con 0x7f6ad80cb100 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40b9680 con 0x7f6ad80cb100 2024-04-25T10:38:35.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad8155e30 con 0x7f6ad80cb100 2024-04-25T10:38:35.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ac40b9860 con 0x7f6ad80cb100 2024-04-25T10:38:35.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6ac40ba3f0 con 0x7f6ad80cb100 2024-04-25T10:38:35.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.833+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad814b030 con 0x7f6ad80cb100 2024-04-25T10:38:35.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.837+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ad81f8a10 con 0x7f6ad80cb100 2024-04-25T10:38:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ad814c480 con 0x7f6ad80cb100 2024-04-25T10:38:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ad4c00640 1 -- 172.21.15.16:0/3660697899 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6ac4018990 con 0x7f6ad80cb100 2024-04-25T10:38:35.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:35.898 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:35.539456+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 msgr2=0x7f6ad8156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ac401f6d0 tx=0x7f6ac401bbd0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 shutdown_connections 2024-04-25T10:38:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ad815a640 0x7f6ad8154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ad80cb100 0x7f6ad8156bf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 --2- 172.21.15.16:0/3660697899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ad80ca7b0 0x7f6ad81f84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 >> 172.21.15.16:0/3660697899 conn(0x7f6ad8071ef0 msgr2=0x7f6ad814fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 shutdown_connections 2024-04-25T10:38:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:35.897+0000 7f6ade600640 1 -- 172.21.15.16:0/3660697899 wait complete. 2024-04-25T10:38:35.918 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T10:38:35.919 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T10:38:35.953 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:35.949+0000 7f5b05ee9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:38:36.069 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T10:38:36.070 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T10:38:36.070 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2024-04-25T10:38:36.103 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:36.101+0000 7f5b05ee9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:38:36.117 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:36.113+0000 7f2c2471b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:38:36.166 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:36.165+0000 7f5b05ee9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:38:36.207 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T10:38:36.205+0000 7fb61b9887c0 -1 Falling back to public interface 2024-04-25T10:38:36.208 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T10:38:36.205+0000 7f498f3b27c0 -1 Falling back to public interface 2024-04-25T10:38:36.223 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T10:38:36.221+0000 7f8b470e57c0 -1 Falling back to public interface 2024-04-25T10:38:36.231 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T10:38:36.229+0000 7f9dbfeff7c0 -1 Falling back to public interface 2024-04-25T10:38:36.231 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T10:38:36.229+0000 7f1fddc347c0 -1 Falling back to public interface 2024-04-25T10:38:36.243 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T10:38:36.241+0000 7feb0ae2b7c0 -1 Falling back to public interface 2024-04-25T10:38:36.262 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T10:38:36.261+0000 7fac6745d7c0 -1 Falling back to public interface 2024-04-25T10:38:36.274 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:36.273+0000 7f2c2471b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:38:36.302 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:36.301+0000 7f5b05ee9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:38:36.303 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T10:38:36.301+0000 7f8be33927c0 -1 Falling back to public interface 2024-04-25T10:38:36.467 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:36.465+0000 7f2c2471b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:38:36.544 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:36.541+0000 7f2c2471b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:38:36.704 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:36.701+0000 7f2c2471b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:38:36.725 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:36.872 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.869+0000 7f8621a00640 1 Processor -- start 2024-04-25T10:38:36.873 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.869+0000 7f8621a00640 1 -- start start 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8621a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c0ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8621a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 0x7f861c0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8621a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f861c15b3b0 con 0x7f861c155300 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8621a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f861c0c9fb0 con 0x7f861c0ca980 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8621a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f861c15b670 con 0x7f861c0c67c0 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861a000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f861c155300 0x7f861c0cb8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51538/0 (socket says 172.21.15.16:51538) 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861a000640 1 -- 172.21.15.16:0/3898477639 learned_addr learned my addr 172.21.15.16:0/3898477639 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:36.875 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861aa00640 1 --2- 172.21.15.16:0/3898477639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c0ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861b400640 1 --2- 172.21.15.16:0/3898477639 >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 0x7f861c0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8619600640 1 -- 172.21.15.16:0/3898477639 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086236664 0 0) 0x7f861c15b3b0 con 0x7f861c155300 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f8619600640 1 -- 172.21.15.16:0/3898477639 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86000035c0 con 0x7f861c155300 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861aa00640 1 -- 172.21.15.16:0/3898477639 >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 msgr2=0x7f861c0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861aa00640 1 --2- 172.21.15.16:0/3898477639 >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 0x7f861c0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861aa00640 1 -- 172.21.15.16:0/3898477639 >> v1:172.21.15.16:6789/0 conn(0x7f861c155300 legacy=0x7f861c0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861aa00640 1 -- 172.21.15.16:0/3898477639 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c15b950 con 0x7f861c0c67c0 2024-04-25T10:38:36.876 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.873+0000 7f861b400640 1 --2- 172.21.15.16:0/3898477639 >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 0x7f861c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:38:36.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f861aa00640 1 --2- 172.21.15.16:0/3898477639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c0ca440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f860c009900 tx=0x7f860c01ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5837ce3c0ee93e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:36.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8619600640 1 -- 172.21.15.16:0/3898477639 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0b5070 con 0x7f861c0c67c0 2024-04-25T10:38:36.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8619600640 1 -- 172.21.15.16:0/3898477639 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860c0a8a90 con 0x7f861c0c67c0 2024-04-25T10:38:36.878 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8619600640 1 -- 172.21.15.16:0/3898477639 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860c0b0440 con 0x7f861c0c67c0 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 -- 172.21.15.16:0/3898477639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 msgr2=0x7f861c0ca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 --2- 172.21.15.16:0/3898477639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c0ca440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f860c009900 tx=0x7f860c01ed90 comp rx=0 tx=0).stop 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 -- 172.21.15.16:0/3898477639 shutdown_connections 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 --2- 172.21.15.16:0/3898477639 >> v2:172.21.15.186:3300/0 conn(0x7f861c0ca980 0x7f861c0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 --2- 172.21.15.16:0/3898477639 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c0ca440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 -- 172.21.15.16:0/3898477639 >> 172.21.15.16:0/3898477639 conn(0x7f861c073140 msgr2=0x7f861c073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 -- 172.21.15.16:0/3898477639 shutdown_connections 2024-04-25T10:38:36.879 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.877+0000 7f8621a00640 1 -- 172.21.15.16:0/3898477639 wait complete. 2024-04-25T10:38:36.881 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 Processor -- start 2024-04-25T10:38:36.881 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- start start 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f861c155300 0x7f861c147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f861c0c96d0 con 0x7f861c0ca980 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f861c0cad90 con 0x7f861c155300 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f861c0cc520 con 0x7f861c0c67c0 2024-04-25T10:38:36.883 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:36.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35458/0 (socket says 172.21.15.16:35458) 2024-04-25T10:38:36.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 -- 172.21.15.16:0/375957585 learned_addr learned my addr 172.21.15.16:0/375957585 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:36.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861aa00640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:36.884 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861b400640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f861c155300 0x7f861c147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:36.885 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 -- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 msgr2=0x7f861c15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 -- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f861c155300 msgr2=0x7f861c147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f861c155300 0x7f861c147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 -- 172.21.15.16:0/375957585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f861c15ccb0 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f861a000640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f861c073110 tx=0x7f860800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608017070 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8608005d30 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86080072d0 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f861c1501d0 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f861c150770 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f860801a070 con 0x7f861c0ca980 2024-04-25T10:38:36.886 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.881+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f860801cca0 con 0x7f861c0ca980 2024-04-25T10:38:36.887 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.885+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f861c069430 con 0x7f861c0ca980 2024-04-25T10:38:36.888 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.885+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8608007490 con 0x7f861c0ca980 2024-04-25T10:38:36.927 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:36.925+0000 7f5b05ee9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:38:36.947 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f861c148650 con 0x7f861c0ca980 2024-04-25T10:38:36.948 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8612a00640 1 -- 172.21.15.16:0/375957585 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f86080076d0 con 0x7f861c0ca980 2024-04-25T10:38:36.948 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-25T10:38:36.948 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:35.539456+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 msgr2=0x7f861c149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f861c073110 tx=0x7f860800c820 comp rx=0 tx=0).stop 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 shutdown_connections 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f861c155300 0x7f861c147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f861c0ca980 0x7f861c149980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 --2- 172.21.15.16:0/375957585 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f861c0c67c0 0x7f861c15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 >> 172.21.15.16:0/375957585 conn(0x7f861c073140 msgr2=0x7f861c1e70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 shutdown_connections 2024-04-25T10:38:36.949 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:36.945+0000 7f8621a00640 1 -- 172.21.15.16:0/375957585 wait complete. 2024-04-25T10:38:36.968 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:38:37.003 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:37.001+0000 7f5b05ee9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:38:37.185 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:37.181+0000 7f5b05ee9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:38:37.259 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:37.257+0000 7f5b05ee9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:38:37.449 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:37.445+0000 7f2c2471b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:38:37.542 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:37.541+0000 7f2c2471b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:38:37.548 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:37.545+0000 7f5b05ee9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:38:37.610 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:37.609+0000 7f5b05ee9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:38:37.761 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:37.761+0000 7f2c2471b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:38:37.852 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:37.849+0000 7f2c2471b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:38:38.203 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:38.201+0000 7f2c2471b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:38:38.278 INFO:tasks.ceph.mgr.y.smithi016.stderr:2024-04-25T10:38:38.277+0000 7f2c2471b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:38:38.657 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:38.653+0000 7f5aac998640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T10:38:38.660 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-04-25T10:38:38.657+0000 7f5aac998640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T10:38:40.095 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T10:38:40.093+0000 7f498f3b27c0 -1 osd.4 0 log_to_monitors true 2024-04-25T10:38:40.132 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T10:38:40.129+0000 7f8b470e57c0 -1 osd.6 0 log_to_monitors true 2024-04-25T10:38:40.147 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T10:38:40.145+0000 7f9dbfeff7c0 -1 osd.7 0 log_to_monitors true 2024-04-25T10:38:40.154 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T10:38:40.153+0000 7f1fddc347c0 -1 osd.5 0 log_to_monitors true 2024-04-25T10:38:40.171 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T10:38:40.169+0000 7fb61b9887c0 -1 osd.0 0 log_to_monitors true 2024-04-25T10:38:40.233 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T10:38:40.229+0000 7feb0ae2b7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T10:38:40.241 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T10:38:40.237+0000 7fac6745d7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T10:38:40.368 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T10:38:40.365+0000 7f8be33927c0 -1 osd.3 0 log_to_monitors true 2024-04-25T10:38:43.193 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T10:38:43.189+0000 7f498b359640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T10:38:43.212 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T10:38:43.209+0000 7f9dbc6ba640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T10:38:43.215 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T10:38:43.213+0000 7f498315a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.223 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T10:38:43.221+0000 7f8b4308c640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T10:38:43.237 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T10:38:43.233+0000 7f1fda3ef640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T10:38:43.247 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T10:38:43.245+0000 7f9db3ca7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.250 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T10:38:43.249+0000 7f8b3ae8d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.266 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T10:38:43.265+0000 7f1fd19dc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.609 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T10:38:43.604+0000 7f8bde200640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T10:38:43.639 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T10:38:43.636+0000 7f8bd4200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.645 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T10:38:43.644+0000 7feb05200640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T10:38:43.653 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T10:38:43.648+0000 7fb616800640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T10:38:43.676 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T10:38:43.672+0000 7fac62400640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T10:38:43.683 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T10:38:43.680+0000 7feafb200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.695 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T10:38:43.692+0000 7fb60c800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.706 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T10:38:43.704+0000 7fac58400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:38:43.773 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:43.914 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 Processor -- start 2024-04-25T10:38:43.915 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 -- start start 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7db815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db815d0e0 con 0x7f7db80c9d60 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db80cc010 con 0x7f7db80cb880 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dbca00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7db815d710 con 0x7f7db80c72a0 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7db5e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7db80c9d60 0x7f7db80c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51542/0 (socket says 172.21.15.16:51542) 2024-04-25T10:38:43.916 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7db5e00640 1 -- 172.21.15.16:0/727900515 learned_addr learned my addr 172.21.15.16:0/727900515 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:43.918 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7dafe00640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7db815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.918 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758198512 0 0) 0x7f7db815d0e0 con 0x7f7db80c9d60 2024-04-25T10:38:43.918 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9c0035c0 con 0x7f7db80c9d60 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.912+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1009022703 0 0) 0x7f7d9c0035c0 con 0x7f7db80c9d60 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 msgr2=0x7f7db815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7db815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 >> v1:172.21.15.186:6789/0 conn(0x7f7db80cb880 legacy=0x7f7db81679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80cc2f0 con 0x7f7db80c9d60 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f7da80016d0 con 0x7f7db80c9d60 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 >> v1:172.21.15.16:6789/0 conn(0x7f7db80c9d60 legacy=0x7f7db80c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7d9c003a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d9c003fc0 0x7f7d9c0048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d9c004de0 0x7f7d9c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7db815d710 con 0x7f7d9c004de0 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9c00bc70 con 0x7f7d9c003fc0 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9c00be70 con 0x7f7db80c72a0 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d9c004de0 0x7f7d9c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.919 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db5e00640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7d9c003a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7dafe00640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d9c003fc0 0x7f7d9c0048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 -- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 msgr2=0x7f7d9c003a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c72a0 0x7f7d9c003a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 -- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d9c003fc0 msgr2=0x7f7d9c0048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d9c003fc0 0x7f7d9c0048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.920 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 -- 172.21.15.16:0/727900515 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c0035c0 con 0x7f7d9c004de0 2024-04-25T10:38:43.921 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.916+0000 7f7db6800640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d9c004de0 0x7f7d9c0051f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7db0001f10 tx=0x7f7db001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a3ad80571cb8cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:43.921 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0001b20 con 0x7f7d9c004de0 2024-04-25T10:38:43.921 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0003b80 con 0x7f7d9c004de0 2024-04-25T10:38:43.921 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7db5400640 1 -- 172.21.15.16:0/727900515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db00050d0 con 0x7f7d9c004de0 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- 172.21.15.16:0/727900515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d9c004de0 msgr2=0x7f7d9c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 --2- 172.21.15.16:0/727900515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d9c004de0 0x7f7d9c0051f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7db0001f10 tx=0x7f7db001c7e0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7db6800640 1 -- 172.21.15.16:0/727900515 reap_dead start 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- 172.21.15.16:0/727900515 shutdown_connections 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- 172.21.15.16:0/727900515 >> 172.21.15.16:0/727900515 conn(0x7f7db8073160 msgr2=0x7f7db8073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- 172.21.15.16:0/727900515 shutdown_connections 2024-04-25T10:38:43.922 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- 172.21.15.16:0/727900515 wait complete. 2024-04-25T10:38:43.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 Processor -- start 2024-04-25T10:38:43.924 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.920+0000 7f7dbca00640 1 -- start start 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 0x7f7db80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c5870 0x7f7db81f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7db815d3a0 con 0x7f7db81f8900 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80c76b0 con 0x7f7db80c3a40 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7db80cbc90 con 0x7f7db80c5870 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 0x7f7db80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dafe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c5870 0x7f7db81f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35506/0 (socket says 172.21.15.16:35506) 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db5e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 0x7f7db80c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:51880/0 (socket says 172.21.15.16:51880) 2024-04-25T10:38:43.927 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 -- 172.21.15.16:0/1923478883 learned_addr learned my addr 172.21.15.16:0/1923478883 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 -- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c5870 msgr2=0x7f7db81f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c5870 0x7f7db81f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 -- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 msgr2=0x7f7db80c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 0x7f7db80c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 -- 172.21.15.16:0/1923478883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db81588b0 con 0x7f7db81f8900 2024-04-25T10:38:43.928 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7db6800640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7db00980e0 tx=0x7f7d9c0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0001b20 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0006b60 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0007dc0 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db80c42a0 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db8157af0 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.924+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8069d80 con 0x7f7db81f8900 2024-04-25T10:38:43.929 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.928+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f7db0007030 con 0x7f7db81f8900 2024-04-25T10:38:43.930 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.928+0000 7f7dae000640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 0x7f7d90071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:43.930 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.928+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f7db0128390 con 0x7f7db81f8900 2024-04-25T10:38:43.931 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.928+0000 7f7db5e00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 0x7f7d90071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:43.932 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.928+0000 7f7db5e00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 0x7f7d90071a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007fd0 tx=0x7f7da80079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:43.936 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:43.932+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7db8069d80 con 0x7f7db81f8900 2024-04-25T10:38:44.105 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.100+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7db8158460 con 0x7f7db81f8900 2024-04-25T10:38:44.106 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dae000640 1 -- 172.21.15.16:0/1923478883 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f7db00ac020 con 0x7f7db81f8900 2024-04-25T10:38:44.106 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-25T10:38:44.106 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":12,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:41.970309+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 msgr2=0x7f7d90071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 0x7f7d90071a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007fd0 tx=0x7f7da80079c0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 msgr2=0x7f7db81fb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7db00980e0 tx=0x7f7d9c0058d0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 shutdown_connections 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d9006f540 0x7f7d90071a50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7db81f8900 0x7f7db81fb9b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7db80c5870 0x7f7db81f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.109 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 --2- 172.21.15.16:0/1923478883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7db80c3a40 0x7f7db80c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:44.109 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 >> 172.21.15.16:0/1923478883 conn(0x7f7db8073160 msgr2=0x7f7db80c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:44.109 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 shutdown_connections 2024-04-25T10:38:44.109 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:44.104+0000 7f7dbca00640 1 -- 172.21.15.16:0/1923478883 wait complete. 2024-04-25T10:38:44.126 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:38:47.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:38:47.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:38:50.932 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:51.086 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 Processor -- start 2024-04-25T10:38:51.086 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 -- start start 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 0x7f1f9c0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 0x7f1f9c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9c1558c0 con 0x7f1f9c0b3070 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9c0b25d0 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9be00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c15c050 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9b400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 0x7f1f9c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.088 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f93e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 0x7f1f9c0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9b400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 0x7f1f9c0cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:41286/0 (socket says 172.21.15.16:41286) 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f9b400640 1 -- 172.21.15.16:0/3787013142 learned_addr learned my addr 172.21.15.16:0/3787013142 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f93e00640 1 -- 172.21.15.16:0/3787013142 >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 msgr2=0x7f1f9c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f93e00640 1 --2- 172.21.15.16:0/3787013142 >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 0x7f1f9c0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f93e00640 1 -- 172.21.15.16:0/3787013142 >> v1:172.21.15.186:6789/0 conn(0x7f1f9c0b3070 legacy=0x7f1f9c0b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.089 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.084+0000 7f1f93e00640 1 -- 172.21.15.16:0/3787013142 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c15b4d0 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.092 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f93e00640 1 --2- 172.21.15.16:0/3787013142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 0x7f1f9c0cb9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009900 tx=0x7f1f8401c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a3053e16d1fca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.092 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9a000640 1 -- 172.21.15.16:0/3787013142 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a9630 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.092 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9a000640 1 -- 172.21.15.16:0/3787013142 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f840a97d0 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.092 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9a000640 1 -- 172.21.15.16:0/3787013142 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a9be0 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.093 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 -- 172.21.15.16:0/3787013142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 msgr2=0x7f1f9c0cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.093 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 --2- 172.21.15.16:0/3787013142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 0x7f1f9c0cb9c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009900 tx=0x7f1f8401c570 comp rx=0 tx=0).stop 2024-04-25T10:38:51.093 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 -- 172.21.15.16:0/3787013142 shutdown_connections 2024-04-25T10:38:51.094 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 --2- 172.21.15.16:0/3787013142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b4fd0 0x7f1f9c0cb9c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.094 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 --2- 172.21.15.16:0/3787013142 >> v2:172.21.15.186:3300/0 conn(0x7f1f9c0cbf00 0x7f1f9c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.094 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.088+0000 7f1f9be00640 1 -- 172.21.15.16:0/3787013142 >> 172.21.15.16:0/3787013142 conn(0x7f1f9c072fd0 msgr2=0x7f1f9c0733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:51.094 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.092+0000 7f1f9be00640 1 -- 172.21.15.16:0/3787013142 shutdown_connections 2024-04-25T10:38:51.094 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.092+0000 7f1f9be00640 1 -- 172.21.15.16:0/3787013142 wait complete. 2024-04-25T10:38:51.096 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.092+0000 7f1f9be00640 1 Processor -- start 2024-04-25T10:38:51.096 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.092+0000 7f1f9be00640 1 -- start start 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b3070 0x7f1f9c0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 0x7f1f9c1f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c15b120 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1f9c0b43a0 con 0x7f1f9c0b4fd0 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9c1f9ad0 con 0x7f1f9c0b3070 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f93e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 0x7f1f9c1f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9aa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b3070 0x7f1f9c0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.098 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42822/0 (socket says 172.21.15.16:42822) 2024-04-25T10:38:51.099 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 -- 172.21.15.16:0/2112383643 learned_addr learned my addr 172.21.15.16:0/2112383643 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:51.099 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f93e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 0x7f1f9c1f90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:41288/0 (socket says 172.21.15.16:41288) 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 -- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b3070 msgr2=0x7f1f9c0c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b3070 0x7f1f9c0c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 -- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 msgr2=0x7f1f9c1f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 0x7f1f9c1f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 -- 172.21.15.16:0/2112383643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9c1f9600 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9b400640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400ede0 tx=0x7f1f9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400cd20 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94019070 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9c1501f0 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f940146c0 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.100 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f9c1507b0 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.101 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.096+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f9c069430 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.101 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.100+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1f94012050 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.102 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.100+0000 7f1f92a00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 0x7f1f74071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.102 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.100+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1f9408f670 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.103 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.100+0000 7f1f9aa00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 0x7f1f74071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.104 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.100+0000 7f1f9aa00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 0x7f1f74071ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001800 tx=0x7f1f8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.108 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.104+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f94010040 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.275 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.272+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f9c000920 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.276 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.272+0000 7f1f92a00640 1 -- 172.21.15.16:0/2112383643 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f1f9405c100 con 0x7f1f9c0cbf00 2024-04-25T10:38:51.277 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-25T10:38:51.277 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":17,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:48.252508+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 msgr2=0x7f1f74071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 0x7f1f74071ab0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c001800 tx=0x7f1f8c009040 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 msgr2=0x7f1f9c0c5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400ede0 tx=0x7f1f9400c490 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 shutdown_connections 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1f7406f5a0 0x7f1f74071ab0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f9c0cbf00 0x7f1f9c0c5a50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f9c0b4fd0 0x7f1f9c1f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 --2- 172.21.15.16:0/2112383643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f9c0b3070 0x7f1f9c0c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.279 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 >> 172.21.15.16:0/2112383643 conn(0x7f1f9c072fd0 msgr2=0x7f1f9c15c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:51.280 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 shutdown_connections 2024-04-25T10:38:51.280 INFO:teuthology.misc.health.smithi016.stderr:2024-04-25T10:38:51.276+0000 7f1f9be00640 1 -- 172.21.15.16:0/2112383643 wait complete. 2024-04-25T10:38:51.297 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T10:38:51.297 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T10:38:51.298 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:38:51.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i a 2024-04-25T10:38:51.301 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:38:51.301 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:38:51.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i c 2024-04-25T10:38:51.304 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:38:51.304 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T10:38:51.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i e 2024-04-25T10:38:51.307 INFO:tasks.ceph.mds.e:Started 2024-04-25T10:38:51.308 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:38:51.308 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i b 2024-04-25T10:38:51.314 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:38:51.314 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:38:51.314 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i d 2024-04-25T10:38:51.317 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:38:51.317 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T10:38:51.318 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mds -f --cluster ceph -i f 2024-04-25T10:38:51.320 INFO:tasks.ceph.mds.f:Started 2024-04-25T10:38:51.320 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T10:38:51.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:51.419 INFO:tasks.ceph.mds.e.smithi016.stdout:starting mds.e at 2024-04-25T10:38:51.420 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-25T10:38:51.420 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2024-04-25T10:38:51.429 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T10:38:51.430 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-04-25T10:38:51.430 INFO:tasks.ceph.mds.f.smithi186.stdout:starting mds.f at 2024-04-25T10:38:51.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 Processor -- start 2024-04-25T10:38:51.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 -- start start 2024-04-25T10:38:51.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 0x7f69980c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f699806d780 0x7f699806db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69980c5b00 con 0x7f699815d3e0 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f69981545f0 con 0x7f699806d780 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f699e600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f69980ca130 con 0x7f699815a8c0 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f6997400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 0x7f69980c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f698fe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f699806d780 0x7f699806db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f6997e00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f699815d3e0 0x7f699815d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:36096/0 (socket says 172.21.15.16:36096) 2024-04-25T10:38:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f6997e00640 1 -- 172.21.15.16:0/2753030453 learned_addr learned my addr 172.21.15.16:0/2753030453 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.484+0000 7f6996a00640 1 -- 172.21.15.16:0/2753030453 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863555839 0 0) 0x7f69980c5b00 con 0x7f699815d3e0 2024-04-25T10:38:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6996a00640 1 -- 172.21.15.16:0/2753030453 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f697c0035c0 con 0x7f699815d3e0 2024-04-25T10:38:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6997400640 1 -- 172.21.15.16:0/2753030453 >> v2:172.21.15.186:3300/0 conn(0x7f699806d780 msgr2=0x7f699806db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:51.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6997400640 1 --2- 172.21.15.16:0/2753030453 >> v2:172.21.15.186:3300/0 conn(0x7f699806d780 0x7f699806db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6997400640 1 -- 172.21.15.16:0/2753030453 >> v1:172.21.15.186:6789/0 conn(0x7f699815d3e0 legacy=0x7f699815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6997400640 1 -- 172.21.15.16:0/2753030453 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69980ca410 con 0x7f699815a8c0 2024-04-25T10:38:51.492 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6997400640 1 --2- 172.21.15.16:0/2753030453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 0x7f69980c9460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6988009900 tx=0x7f698801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e28f70f1e445f4d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.488+0000 7f6996a00640 1 -- 172.21.15.16:0/2753030453 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880b1070 con 0x7f699815a8c0 2024-04-25T10:38:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f6996a00640 1 -- 172.21.15.16:0/2753030453 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69880ac640 con 0x7f699815a8c0 2024-04-25T10:38:51.493 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f6996a00640 1 -- 172.21.15.16:0/2753030453 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880aca50 con 0x7f699815a8c0 2024-04-25T10:38:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- 172.21.15.16:0/2753030453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 msgr2=0x7f69980c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 --2- 172.21.15.16:0/2753030453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 0x7f69980c9460 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6988009900 tx=0x7f698801c510 comp rx=0 tx=0).stop 2024-04-25T10:38:51.494 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- 172.21.15.16:0/2753030453 shutdown_connections 2024-04-25T10:38:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 --2- 172.21.15.16:0/2753030453 >> v2:172.21.15.186:3300/0 conn(0x7f699806d780 0x7f699806db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 --2- 172.21.15.16:0/2753030453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699815a8c0 0x7f69980c9460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- 172.21.15.16:0/2753030453 >> 172.21.15.16:0/2753030453 conn(0x7f6998072950 msgr2=0x7f69980ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- 172.21.15.16:0/2753030453 shutdown_connections 2024-04-25T10:38:51.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- 172.21.15.16:0/2753030453 wait complete. 2024-04-25T10:38:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 Processor -- start 2024-04-25T10:38:51.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.492+0000 7f699e600640 1 -- start start 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699806d780 0x7f69981391b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f699815d3e0 0x7f69981405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f69980ca770 con 0x7f699815a8c0 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f69980c3f20 con 0x7f699815d3e0 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f699815acd0 con 0x7f699806d780 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42864/0 (socket says 172.21.15.16:42864) 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 -- 172.21.15.16:0/300958529 learned_addr learned my addr 172.21.15.16:0/300958529 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:51.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f6997400640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699806d780 0x7f69981391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f6997e00640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f699815d3e0 0x7f69981405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 -- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699806d780 msgr2=0x7f69981391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699806d780 0x7f69981391b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 -- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f699815d3e0 msgr2=0x7f69981405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f699815d3e0 0x7f69981405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.500 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 -- 172.21.15.16:0/300958529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69981411a0 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698fe00640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f698000e8b0 tx=0x7f698000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980017070 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698000c940 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698000ccf0 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6998146110 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69981466d0 con 0x7f699815a8c0 2024-04-25T10:38:51.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.496+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998050750 con 0x7f699815a8c0 2024-04-25T10:38:51.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.500+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f698001a070 con 0x7f699815a8c0 2024-04-25T10:38:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.500+0000 7f698f400640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 0x7f6970071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.500+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f698008ef60 con 0x7f699815a8c0 2024-04-25T10:38:51.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.500+0000 7f6997400640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 0x7f6970071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.500+0000 7f6997400640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 0x7f6970071ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69880ae000 tx=0x7f6988008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.504+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f698005bb00 con 0x7f699815a8c0 2024-04-25T10:38:51.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.672+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69980c3a00 con 0x7f699815a8c0 2024-04-25T10:38:51.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.672+0000 7f698f400640 1 -- 172.21.15.16:0/300958529 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f698005fe00 con 0x7f699815a8c0 2024-04-25T10:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:51.676 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:48.252508+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:51.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 msgr2=0x7f6970071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 0x7f6970071ab0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69880ae000 tx=0x7f6988008040 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 msgr2=0x7f69981fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f698000e8b0 tx=0x7f698000ed70 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 shutdown_connections 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f697006f5a0 0x7f6970071ab0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f699815d3e0 0x7f69981405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f699815a8c0 0x7f69981fcc10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 --2- 172.21.15.16:0/300958529 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f699806d780 0x7f69981391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 >> 172.21.15.16:0/300958529 conn(0x7f6998072950 msgr2=0x7f6998139e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 shutdown_connections 2024-04-25T10:38:51.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.676+0000 7f699e600640 1 -- 172.21.15.16:0/300958529 wait complete. 2024-04-25T10:38:51.698 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:38:51.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:38:51.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 Processor -- start 2024-04-25T10:38:51.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 -- start start 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500c67e0 0x7fbe5015b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbe5015bbe0 0x7fbe500cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5015e8b0 con 0x7fbe500cc700 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5015f430 con 0x7fbe5015bbe0 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe57e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5015eb90 con 0x7fbe500c67e0 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbe5015bbe0 0x7fbe500cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbe5015bbe0 0x7fbe500cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42876/0 (socket says 172.21.15.16:42876) 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 -- 172.21.15.16:0/3397804275 learned_addr learned my addr 172.21.15.16:0/3397804275 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe55e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbe500cc700 0x7fbe500c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43706/0 (socket says 172.21.15.16:43706) 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe55400640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500c67e0 0x7fbe5015b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 -- 172.21.15.16:0/3397804275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500c67e0 msgr2=0x7fbe5015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:51.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500c67e0 0x7fbe5015b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 -- 172.21.15.16:0/3397804275 >> v1:172.21.15.16:6789/0 conn(0x7fbe500cc700 legacy=0x7fbe500c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.857 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.852+0000 7fbe54a00640 1 -- 172.21.15.16:0/3397804275 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5015ee70 con 0x7fbe5015bbe0 2024-04-25T10:38:51.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe54a00640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe500cc1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0099d0 tx=0x7fbe3c01ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f865d493e93affb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe4fe00640 1 -- 172.21.15.16:0/3397804275 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0b5070 con 0x7fbe5015bbe0 2024-04-25T10:38:51.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe4fe00640 1 -- 172.21.15.16:0/3397804275 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0a8b70 con 0x7fbe5015bbe0 2024-04-25T10:38:51.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe4fe00640 1 -- 172.21.15.16:0/3397804275 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c0b0440 con 0x7fbe5015bbe0 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 -- 172.21.15.16:0/3397804275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 msgr2=0x7fbe500cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe500cc1c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0099d0 tx=0x7fbe3c01ee70 comp rx=0 tx=0).stop 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 -- 172.21.15.16:0/3397804275 shutdown_connections 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe500cc1c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 --2- 172.21.15.16:0/3397804275 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500c67e0 0x7fbe5015b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 -- 172.21.15.16:0/3397804275 >> 172.21.15.16:0/3397804275 conn(0x7fbe500732e0 msgr2=0x7fbe500736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:51.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 -- 172.21.15.16:0/3397804275 shutdown_connections 2024-04-25T10:38:51.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.856+0000 7fbe57e00640 1 -- 172.21.15.16:0/3397804275 wait complete. 2024-04-25T10:38:51.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 Processor -- start 2024-04-25T10:38:51.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 -- start start 2024-04-25T10:38:51.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe500c67e0 0x7fbe5015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500cc700 0x7fbe500c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5015e4e0 con 0x7fbe5015bbe0 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5015b180 con 0x7fbe500c67e0 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe57e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5015e660 con 0x7fbe500cc700 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42878/0 (socket says 172.21.15.16:42878) 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 -- 172.21.15.16:0/1503711681 learned_addr learned my addr 172.21.15.16:0/1503711681 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe54a00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500cc700 0x7fbe500c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55400640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe500c67e0 0x7fbe5015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 -- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500cc700 msgr2=0x7fbe500c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500cc700 0x7fbe500c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 -- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe500c67e0 msgr2=0x7fbe5015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe500c67e0 0x7fbe5015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:51.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 -- 172.21.15.16:0/1503711681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5015a710 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.860+0000 7fbe55e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c7f0 tx=0x7fbe4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48017070 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4800a640 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800a9f0 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe500c1c50 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5014a5c0 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe500c6ee0 con 0x7fbe5015bbe0 2024-04-25T10:38:51.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe4801a070 con 0x7fbe5015bbe0 2024-04-25T10:38:51.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 0x7fbe2c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:51.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbe4808e470 con 0x7fbe5015bbe0 2024-04-25T10:38:51.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.864+0000 7fbe55400640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 0x7fbe2c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:51.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.868+0000 7fbe55400640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 0x7fbe2c071ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe44006fd0 tx=0x7fbe44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:51.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:51.868+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe4805b0a0 con 0x7fbe5015bbe0 2024-04-25T10:38:52.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.032+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbe500701c0 con 0x7fbe5015bbe0 2024-04-25T10:38:52.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.032+0000 7fbe4d600640 1 -- 172.21.15.16:0/1503711681 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fbe4805f3a0 con 0x7fbe5015bbe0 2024-04-25T10:38:52.037 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 msgr2=0x7fbe2c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 0x7fbe2c071ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe44006fd0 tx=0x7fbe44008040 comp rx=0 tx=0).stop 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 msgr2=0x7fbe5014c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800c7f0 tx=0x7fbe4800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 shutdown_connections 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbe2c06f5a0 0x7fbe2c071ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe5015bbe0 0x7fbe5014c900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbe500cc700 0x7fbe500c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 --2- 172.21.15.16:0/1503711681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbe500c67e0 0x7fbe5015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 >> 172.21.15.16:0/1503711681 conn(0x7fbe500732e0 msgr2=0x7fbe500ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:52.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 shutdown_connections 2024-04-25T10:38:52.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.036+0000 7fbe57e00640 1 -- 172.21.15.16:0/1503711681 wait complete. 2024-04-25T10:38:52.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:38:52.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 Processor -- start 2024-04-25T10:38:52.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 -- start start 2024-04-25T10:38:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2fe40c8b40 0x7f2fe40b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe406e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe406ce70 con 0x7f2fe4154fc0 2024-04-25T10:38:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe415e230 con 0x7f2fe40c8b40 2024-04-25T10:38:52.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2feae00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe406d150 con 0x7f2fe406dc50 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fe9000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2fe40c8b40 0x7f2fe40b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fea400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe406e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fe9a00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f2fe4154fc0 0x7f2fe406c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:36104/0 (socket says 172.21.15.16:36104) 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fe9a00640 1 -- 172.21.15.16:0/3725680592 learned_addr learned my addr 172.21.15.16:0/3725680592 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fea400640 1 -- 172.21.15.16:0/3725680592 >> v2:172.21.15.186:3300/0 conn(0x7f2fe40c8b40 msgr2=0x7f2fe40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fea400640 1 --2- 172.21.15.16:0/3725680592 >> v2:172.21.15.186:3300/0 conn(0x7f2fe40c8b40 0x7f2fe40b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fea400640 1 -- 172.21.15.16:0/3725680592 >> v1:172.21.15.186:6789/0 conn(0x7f2fe4154fc0 legacy=0x7f2fe406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.208+0000 7f2fea400640 1 -- 172.21.15.16:0/3725680592 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe415e480 con 0x7f2fe406dc50 2024-04-25T10:38:52.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2fea400640 1 --2- 172.21.15.16:0/3725680592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe406e060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2fe415e3b0 tx=0x7f2fdc01ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e483a9736dddd9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2fe3e00640 1 -- 172.21.15.16:0/3725680592 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0b2070 con 0x7f2fe406dc50 2024-04-25T10:38:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2fe3e00640 1 -- 172.21.15.16:0/3725680592 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0a5a30 con 0x7f2fe406dc50 2024-04-25T10:38:52.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2fe3e00640 1 -- 172.21.15.16:0/3725680592 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0a5e40 con 0x7f2fe406dc50 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2feae00640 1 -- 172.21.15.16:0/3725680592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 msgr2=0x7f2fe406e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.212+0000 7f2feae00640 1 --2- 172.21.15.16:0/3725680592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe406e060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2fe415e3b0 tx=0x7f2fdc01ca50 comp rx=0 tx=0).stop 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 -- 172.21.15.16:0/3725680592 shutdown_connections 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 --2- 172.21.15.16:0/3725680592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe406e060 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 --2- 172.21.15.16:0/3725680592 >> v2:172.21.15.186:3300/0 conn(0x7f2fe40c8b40 0x7f2fe40b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 -- 172.21.15.16:0/3725680592 >> 172.21.15.16:0/3725680592 conn(0x7f2fe4072490 msgr2=0x7f2fe40ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:52.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 -- 172.21.15.16:0/3725680592 shutdown_connections 2024-04-25T10:38:52.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 -- 172.21.15.16:0/3725680592 wait complete. 2024-04-25T10:38:52.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 Processor -- start 2024-04-25T10:38:52.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.216+0000 7f2feae00640 1 -- start start 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe4152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fe4154fc0 0x7f2fe414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40c8f50 con 0x7f2fe40c8b40 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe41553d0 con 0x7f2fe4154fc0 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40c90d0 con 0x7f2fe406dc50 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:42884/0 (socket says 172.21.15.16:42884) 2024-04-25T10:38:52.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 -- 172.21.15.16:0/1294356022 learned_addr learned my addr 172.21.15.16:0/1294356022 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:52.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9a00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe4152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fea400640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fe4154fc0 0x7f2fe414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 -- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 msgr2=0x7f2fe4152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe4152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 -- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fe4154fc0 msgr2=0x7f2fe414ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fe4154fc0 0x7f2fe414ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 -- 172.21.15.16:0/1294356022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe41fca30 con 0x7f2fe40c8b40 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe9000640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009fd0 tx=0x7f2fd000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0017070 con 0x7f2fe40c8b40 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd000c940 con 0x7f2fe40c8b40 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000cd30 con 0x7f2fe40c8b40 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe4148ce0 con 0x7f2fe40c8b40 2024-04-25T10:38:52.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41492a0 con 0x7f2fe40c8b40 2024-04-25T10:38:52.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4076d30 con 0x7f2fe40c8b40 2024-04-25T10:38:52.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.220+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2fd001a070 con 0x7f2fe40c8b40 2024-04-25T10:38:52.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.224+0000 7f2fe1600640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 0x7f2fc0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:52.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.224+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2fd008eeb0 con 0x7f2fe40c8b40 2024-04-25T10:38:52.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.224+0000 7f2fe9a00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 0x7f2fc0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:52.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.224+0000 7f2fe9a00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 0x7f2fc0071ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80058d0 tx=0x7f2fd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:52.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.228+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2fd005bae0 con 0x7f2fe40c8b40 2024-04-25T10:38:52.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.428+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe4150360 con 0x7f2fe40c8b40 2024-04-25T10:38:52.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.428+0000 7f2fe1600640 1 -- 172.21.15.16:0/1294356022 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f2fd005fde0 con 0x7f2fe40c8b40 2024-04-25T10:38:52.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:52.433 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T10:38:52.434 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 msgr2=0x7f2fc0071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 0x7f2fc0071ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80058d0 tx=0x7f2fd8009040 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 msgr2=0x7f2fe41fc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009fd0 tx=0x7f2fd000ed40 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 shutdown_connections 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2fc006f5d0 0x7f2fc0071ae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fe4154fc0 0x7f2fe414ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe40c8b40 0x7f2fe41fc4f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 --2- 172.21.15.16:0/1294356022 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fe406dc50 0x7f2fe4152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 >> 172.21.15.16:0/1294356022 conn(0x7f2fe4072490 msgr2=0x7f2fe41ecaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 shutdown_connections 2024-04-25T10:38:52.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:52.432+0000 7f2feae00640 1 -- 172.21.15.16:0/1294356022 wait complete. 2024-04-25T10:38:54.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:38:54.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 Processor -- start 2024-04-25T10:38:54.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 -- start start 2024-04-25T10:38:54.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6df815ef60 0x7f6df8155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6df80cc1a0 0x7f6df80cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.625 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80c6ef0 con 0x7f6df80c7cb0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6df815f370 con 0x7f6df80cc1a0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6dfd200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6df80c74c0 con 0x7f6df815ef60 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6defe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6df80c7cb0 0x7f6df80c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37864/0 (socket says 172.21.15.16:37864) 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6defe00640 1 -- 172.21.15.16:0/2332771359 learned_addr learned my addr 172.21.15.16:0/2332771359 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6df6800640 1 --2- 172.21.15.16:0/2332771359 >> v2:172.21.15.16:3300/0 conn(0x7f6df80cc1a0 0x7f6df80cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.620+0000 7f6df5e00640 1 --2- 172.21.15.16:0/2332771359 >> v2:172.21.15.186:3300/0 conn(0x7f6df815ef60 0x7f6df8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df5400640 1 -- 172.21.15.16:0/2332771359 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595185208 0 0) 0x7f6df80c6ef0 con 0x7f6df80c7cb0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df5400640 1 -- 172.21.15.16:0/2332771359 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ddc0035c0 con 0x7f6df80c7cb0 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df6800640 1 -- 172.21.15.16:0/2332771359 >> v2:172.21.15.186:3300/0 conn(0x7f6df815ef60 msgr2=0x7f6df8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df6800640 1 --2- 172.21.15.16:0/2332771359 >> v2:172.21.15.186:3300/0 conn(0x7f6df815ef60 0x7f6df8155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df6800640 1 -- 172.21.15.16:0/2332771359 >> v1:172.21.15.16:6789/0 conn(0x7f6df80c7cb0 legacy=0x7f6df80c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df6800640 1 -- 172.21.15.16:0/2332771359 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80c7710 con 0x7f6df80cc1a0 2024-04-25T10:38:54.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df6800640 1 --2- 172.21.15.16:0/2332771359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df80cc1a0 0x7f6df80cc5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6df80d0450 tx=0x7f6df001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadbc0fbd74a7fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:54.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df5400640 1 -- 172.21.15.16:0/2332771359 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00b2070 con 0x7f6df80cc1a0 2024-04-25T10:38:54.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df5400640 1 -- 172.21.15.16:0/2332771359 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df00a5900 con 0x7f6df80cc1a0 2024-04-25T10:38:54.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.624+0000 7f6df5400640 1 -- 172.21.15.16:0/2332771359 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00a5d10 con 0x7f6df80cc1a0 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- 172.21.15.16:0/2332771359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df80cc1a0 msgr2=0x7f6df80cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 --2- 172.21.15.16:0/2332771359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df80cc1a0 0x7f6df80cc5b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6df80d0450 tx=0x7f6df001ca30 comp rx=0 tx=0).stop 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- 172.21.15.16:0/2332771359 shutdown_connections 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 --2- 172.21.15.16:0/2332771359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df80cc1a0 0x7f6df80cc5b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 --2- 172.21.15.16:0/2332771359 >> v2:172.21.15.186:3300/0 conn(0x7f6df815ef60 0x7f6df8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- 172.21.15.16:0/2332771359 >> 172.21.15.16:0/2332771359 conn(0x7f6df80732e0 msgr2=0x7f6df80736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- 172.21.15.16:0/2332771359 shutdown_connections 2024-04-25T10:38:54.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- 172.21.15.16:0/2332771359 wait complete. 2024-04-25T10:38:54.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 Processor -- start 2024-04-25T10:38:54.632 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.628+0000 7f6dfd200640 1 -- start start 2024-04-25T10:38:54.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6df80c7cb0 0x7f6df815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6df80cc1a0 0x7f6df815db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80c80c0 con 0x7f6df815ef60 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80c4000 con 0x7f6df80cc1a0 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6df80c8240 con 0x7f6df80c7cb0 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49684/0 (socket says 172.21.15.16:49684) 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 -- 172.21.15.16:0/27663843 learned_addr learned my addr 172.21.15.16:0/27663843 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df5e00640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6df80c7cb0 0x7f6df815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6defe00640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6df80cc1a0 0x7f6df815db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 -- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6df80c7cb0 msgr2=0x7f6df815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6df80c7cb0 0x7f6df815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 -- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6df80cc1a0 msgr2=0x7f6df815db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6df80cc1a0 0x7f6df815db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 -- 172.21.15.16:0/27663843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df81ef6c0 con 0x7f6df815ef60 2024-04-25T10:38:54.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6df6800640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6df00b0040 tx=0x7f6df00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00b2050 con 0x7f6df815ef60 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df00be070 con 0x7f6df815ef60 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df00ad850 con 0x7f6df815ef60 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df814fba0 con 0x7f6df815ef60 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df8153e50 con 0x7f6df815ef60 2024-04-25T10:38:54.636 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.632+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df8154090 con 0x7f6df815ef60 2024-04-25T10:38:54.637 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.636+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6df00adab0 con 0x7f6df815ef60 2024-04-25T10:38:54.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.636+0000 7f6dee000640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 0x7f6dd0075ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:54.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.636+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6df012a220 con 0x7f6df815ef60 2024-04-25T10:38:54.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.636+0000 7f6df5e00640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 0x7f6dd0075ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:54.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.636+0000 7f6df5e00640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 0x7f6dd0075ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6df8158c10 tx=0x7f6de8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:54.643 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.640+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6df8154090 con 0x7f6df815ef60 2024-04-25T10:38:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.840+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df814bc70 con 0x7f6df815ef60 2024-04-25T10:38:54.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.840+0000 7f6dee000640 1 -- 172.21.15.16:0/27663843 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5521 (secure 0 0 0) 0x7f6df0128e20 con 0x7f6df815ef60 2024-04-25T10:38:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:54.845 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4306,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T10:38:54.845 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2024-04-25T10:38:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 msgr2=0x7f6dd0075ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 0x7f6dd0075ec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6df8158c10 tx=0x7f6de8008040 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 msgr2=0x7f6df81edee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6df00b0040 tx=0x7f6df00197d0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 shutdown_connections 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6dd00739b0 0x7f6dd0075ec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6df815ef60 0x7f6df81edee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6df80cc1a0 0x7f6df815db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 --2- 172.21.15.16:0/27663843 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6df80c7cb0 0x7f6df815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 >> 172.21.15.16:0/27663843 conn(0x7f6df80732e0 msgr2=0x7f6df80c83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 shutdown_connections 2024-04-25T10:38:54.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:54.844+0000 7f6dfd200640 1 -- 172.21.15.16:0/27663843 wait complete. 2024-04-25T10:38:54.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:38:55.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.016+0000 7fd13c200640 1 Processor -- start 2024-04-25T10:38:55.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.016+0000 7fd13c200640 1 -- start start 2024-04-25T10:38:55.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13c200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd1340c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13c200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd1340c4df0 0x7fd1341647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13c200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1340ca9e0 con 0x7fd1340c9190 2024-04-25T10:38:55.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13c200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340c7c40 con 0x7fd1340c4df0 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13c200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd1340c7e90 con 0x7fd134153fc0 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd138e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd1340c9190 0x7fd1340c46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37874/0 (socket says 172.21.15.16:37874) 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd138e00640 1 -- 172.21.15.16:0/908509999 learned_addr learned my addr 172.21.15.16:0/908509999 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13a200640 1 --2- 172.21.15.16:0/908509999 >> v2:172.21.15.186:3300/0 conn(0x7fd1340c4df0 0x7fd1341647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd1340c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541049642 0 0) 0x7fd1340ca9e0 con 0x7fd1340c9190 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd11c0035c0 con 0x7fd1340c9190 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 711753823 0 0) 0x7fd11c0035c0 con 0x7fd1340c9190 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 msgr2=0x7fd1340c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd1340c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 >> v2:172.21.15.186:3300/0 conn(0x7fd1340c4df0 msgr2=0x7fd1341647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 --2- 172.21.15.16:0/908509999 >> v2:172.21.15.186:3300/0 conn(0x7fd1340c4df0 0x7fd1341647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340c8170 con 0x7fd1340c9190 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fd1200016d0 con 0x7fd1340c9190 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 >> v1:172.21.15.16:6789/0 conn(0x7fd1340c9190 legacy=0x7fd1340c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11c003a50 0x7fd11c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd11c0048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd11c004de0 0x7fd11c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd1340c7c40 con 0x7fd11c003a50 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd1340c7e90 con 0x7fd11c004de0 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd11c00ba60 con 0x7fd134153fc0 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11c003a50 0x7fd11c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd138e00640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd11c0048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd13a200640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd11c004de0 0x7fd11c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 -- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 msgr2=0x7fd11c0048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd134153fc0 0x7fd11c0048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 -- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd11c004de0 msgr2=0x7fd11c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd11c004de0 0x7fd11c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.020+0000 7fd139800640 1 -- 172.21.15.16:0/908509999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c0035c0 con 0x7fd11c003a50 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd139800640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11c003a50 0x7fd11c003ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd128009b60 tx=0x7fd12801cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a501b09d8ffb499 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128009730 con 0x7fd11c003a50 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1280a64c0 con 0x7fd11c003a50 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd133e00640 1 -- 172.21.15.16:0/908509999 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a68d0 con 0x7fd11c003a50 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 -- 172.21.15.16:0/908509999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11c003a50 msgr2=0x7fd11c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 --2- 172.21.15.16:0/908509999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd11c003a50 0x7fd11c003ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd128009b60 tx=0x7fd12801cad0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13a200640 1 -- 172.21.15.16:0/908509999 reap_dead start 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 -- 172.21.15.16:0/908509999 shutdown_connections 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 -- 172.21.15.16:0/908509999 >> 172.21.15.16:0/908509999 conn(0x7fd1340cdc80 msgr2=0x7fd1340c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 -- 172.21.15.16:0/908509999 shutdown_connections 2024-04-25T10:38:55.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.024+0000 7fd13c200640 1 -- 172.21.15.16:0/908509999 wait complete. 2024-04-25T10:38:55.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 Processor -- start 2024-04-25T10:38:55.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- start start 2024-04-25T10:38:55.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1341ebd10 0x7fd1341569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1341fbcc0 0x7fd13414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd134154550 con 0x7fd1341ed540 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341543d0 con 0x7fd1341fbcc0 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd1340ca5a0 con 0x7fd1341ebd10 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49704/0 (socket says 172.21.15.16:49704) 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 -- 172.21.15.16:0/4248092856 learned_addr learned my addr 172.21.15.16:0/4248092856 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd139800640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1341ebd10 0x7fd1341569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13a200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1341fbcc0 0x7fd13414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 -- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1341ebd10 msgr2=0x7fd1341569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1341ebd10 0x7fd1341569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 -- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1341fbcc0 msgr2=0x7fd13414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1341fbcc0 0x7fd13414d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 -- 172.21.15.16:0/4248092856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341ffbd0 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd138e00640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd120001260 tx=0x7fd12000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000c8d0 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd120018070 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341edc80 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000ccf0 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.028+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341ff0f0 con 0x7fd1341ed540 2024-04-25T10:38:55.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134157860 con 0x7fd1341ed540 2024-04-25T10:38:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd12001d460 con 0x7fd1341ed540 2024-04-25T10:38:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd131600640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 0x7fd110071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd12008ef90 con 0x7fd1341ed540 2024-04-25T10:38:55.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd139800640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 0x7fd110071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.032+0000 7fd139800640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 0x7fd110071a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1280af000 tx=0x7fd1280046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.036+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd12005c210 con 0x7fd1341ed540 2024-04-25T10:38:55.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.204+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd13414e000 con 0x7fd1341ed540 2024-04-25T10:38:55.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd131600640 1 -- 172.21.15.16:0/4248092856 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7fd120064020 con 0x7fd1341ed540 2024-04-25T10:38:55.210 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:55.210 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:38:48.252508+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 msgr2=0x7fd110071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 0x7fd110071a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1280af000 tx=0x7fd1280046d0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 msgr2=0x7fd1341fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd120001260 tx=0x7fd12000ed20 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 shutdown_connections 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd11006f540 0x7fd110071a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1341fbcc0 0x7fd13414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1341ed540 0x7fd1341fb780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 --2- 172.21.15.16:0/4248092856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd1341ebd10 0x7fd1341569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 >> 172.21.15.16:0/4248092856 conn(0x7fd1340cdc80 msgr2=0x7fd1340cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 shutdown_connections 2024-04-25T10:38:55.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.208+0000 7fd13c200640 1 -- 172.21.15.16:0/4248092856 wait complete. 2024-04-25T10:38:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:38:55.232 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:38:55.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 Processor -- start 2024-04-25T10:38:55.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 -- start start 2024-04-25T10:38:55.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0cc1c0 0x7fcd8c0cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcd8c163800 0x7fcd8c165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c15e8b0 con 0x7fcd8c0c67e0 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8c15f430 con 0x7fcd8c163800 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd93a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c15eb90 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd91a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcd8c163800 0x7fcd8c165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd91a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcd8c163800 0x7fcd8c165c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49716/0 (socket says 172.21.15.16:49716) 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd91a00640 1 -- 172.21.15.16:0/3859896613 learned_addr learned my addr 172.21.15.16:0/3859896613 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:55.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.384+0000 7fcd8be00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0cc1c0 0x7fcd8c0cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd91a00640 1 -- 172.21.15.16:0/3859896613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0cc1c0 msgr2=0x7fcd8c0cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd91a00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0cc1c0 0x7fcd8c0cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd91a00640 1 -- 172.21.15.16:0/3859896613 >> v1:172.21.15.186:6789/0 conn(0x7fcd8c0c67e0 legacy=0x7fcd8c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd91a00640 1 -- 172.21.15.16:0/3859896613 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c15ee70 con 0x7fcd8c163800 2024-04-25T10:38:55.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd91a00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c163800 0x7fcd8c165c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009fa0 tx=0x7fcd8401f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd73a3d0306dc8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd8b400640 1 -- 172.21.15.16:0/3859896613 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840b4070 con 0x7fcd8c163800 2024-04-25T10:38:55.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd8b400640 1 -- 172.21.15.16:0/3859896613 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd840092d0 con 0x7fcd8c163800 2024-04-25T10:38:55.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.388+0000 7fcd8b400640 1 -- 172.21.15.16:0/3859896613 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84007680 con 0x7fcd8c163800 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- 172.21.15.16:0/3859896613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c163800 msgr2=0x7fcd8c165c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c163800 0x7fcd8c165c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009fa0 tx=0x7fcd8401f310 comp rx=0 tx=0).stop 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- 172.21.15.16:0/3859896613 shutdown_connections 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c163800 0x7fcd8c165c20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 --2- 172.21.15.16:0/3859896613 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0cc1c0 0x7fcd8c0cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- 172.21.15.16:0/3859896613 >> 172.21.15.16:0/3859896613 conn(0x7fcd8c0732e0 msgr2=0x7fcd8c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- 172.21.15.16:0/3859896613 shutdown_connections 2024-04-25T10:38:55.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- 172.21.15.16:0/3859896613 wait complete. 2024-04-25T10:38:55.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 Processor -- start 2024-04-25T10:38:55.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.392+0000 7fcd93a00640 1 -- start start 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0c67e0 0x7fcd8c1f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 0x7fcd8c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c15bdb0 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c15b180 con 0x7fcd8c163800 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c15bf30 con 0x7fcd8c0c67e0 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49732/0 (socket says 172.21.15.16:49732) 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 -- 172.21.15.16:0/1302013219 learned_addr learned my addr 172.21.15.16:0/1302013219 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd91a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 0x7fcd8c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd91000640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0c67e0 0x7fcd8c1f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 -- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0c67e0 msgr2=0x7fcd8c1f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0c67e0 0x7fcd8c1f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 -- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 msgr2=0x7fcd8c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 0x7fcd8c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 -- 172.21.15.16:0/1302013219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c1fc180 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd91a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 0x7fcd8c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:55.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd8be00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800e8b0 tx=0x7fcd7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78017070 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7800c940 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800ccf0 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c1fc460 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c06ed10 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.396+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8c06f080 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.400+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcd7801a070 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.400+0000 7fcd88c00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 0x7fcd68071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.400+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcd7808f080 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.400+0000 7fcd91000640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 0x7fcd68071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.404 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.400+0000 7fcd91000640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 0x7fcd68071ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001640 tx=0x7fcd80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.404+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd7805c1c0 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.568+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd8c0ce7e0 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.568+0000 7fcd88c00640 1 -- 172.21.15.16:0/1302013219 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fcd7805bac0 con 0x7fcd8c0cc1c0 2024-04-25T10:38:55.573 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:38:55.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 msgr2=0x7fcd68071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 0x7fcd68071ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001640 tx=0x7fcd80009040 comp rx=0 tx=0).stop 2024-04-25T10:38:55.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 msgr2=0x7fcd8c06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800e8b0 tx=0x7fcd7800ed70 comp rx=0 tx=0).stop 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 shutdown_connections 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcd6806f5a0 0x7fcd68071ab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd8c163800 0x7fcd8c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd8c0cc1c0 0x7fcd8c06e7d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 --2- 172.21.15.16:0/1302013219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd8c0c67e0 0x7fcd8c1f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 >> 172.21.15.16:0/1302013219 conn(0x7fcd8c0732e0 msgr2=0x7fcd8c159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 shutdown_connections 2024-04-25T10:38:55.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.572+0000 7fcd93a00640 1 -- 172.21.15.16:0/1302013219 wait complete. 2024-04-25T10:38:55.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:38:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 Processor -- start 2024-04-25T10:38:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 -- start start 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40c80f0 0x7fcbf41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcbf40cbea0 0x7fcbf40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf40c7910 con 0x7fcbf415e7a0 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcbf40c6bc0 con 0x7fcbf40cbea0 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf8c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40c6e80 con 0x7fcbf40c80f0 2024-04-25T10:38:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf2800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcbf415e7a0 0x7fcbf415ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37882/0 (socket says 172.21.15.16:37882) 2024-04-25T10:38:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.744+0000 7fcbf2800640 1 -- 172.21.15.16:0/1262246518 learned_addr learned my addr 172.21.15.16:0/1262246518 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbf1e00640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40c80f0 0x7fcbf41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 --2- 172.21.15.16:0/1262246518 >> v2:172.21.15.186:3300/0 conn(0x7fcbf40cbea0 0x7fcbf40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522642571 0 0) 0x7fcbf40c7910 con 0x7fcbf415e7a0 2024-04-25T10:38:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd80035c0 con 0x7fcbf415e7a0 2024-04-25T10:38:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 -- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40c80f0 msgr2=0x7fcbf41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40c80f0 0x7fcbf41551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 -- 172.21.15.16:0/1262246518 >> v1:172.21.15.16:6789/0 conn(0x7fcbf415e7a0 legacy=0x7fcbf415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229963774 0 0) 0x7fcbd80035c0 con 0x7fcbf415e7a0 2024-04-25T10:38:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 -- 172.21.15.16:0/1262246518 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf40c7630 con 0x7fcbf40cbea0 2024-04-25T10:38:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.748+0000 7fcbe9400640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf40cbea0 0x7fcbf40cc2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009900 tx=0x7fcbdc01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54645dcbc103de22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0b5070 con 0x7fcbf40cbea0 2024-04-25T10:38:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0a8730 con 0x7fcbf40cbea0 2024-04-25T10:38:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf1400640 1 -- 172.21.15.16:0/1262246518 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec001a50 con 0x7fcbf40cbea0 2024-04-25T10:38:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf40cbea0 msgr2=0x7fcbf40cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf40cbea0 0x7fcbf40cc2b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009900 tx=0x7fcbdc01ecb0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- 172.21.15.16:0/1262246518 shutdown_connections 2024-04-25T10:38:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf40cbea0 0x7fcbf40cc2b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/1262246518 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40c80f0 0x7fcbf41551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- 172.21.15.16:0/1262246518 >> 172.21.15.16:0/1262246518 conn(0x7fcbf4073160 msgr2=0x7fcbf4073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- 172.21.15.16:0/1262246518 shutdown_connections 2024-04-25T10:38:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- 172.21.15.16:0/1262246518 wait complete. 2024-04-25T10:38:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 Processor -- start 2024-04-25T10:38:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.752+0000 7fcbf8c00640 1 -- start start 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40cbea0 0x7fcbf40c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 0x7fcbf40c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf40cb9d0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf4155700 con 0x7fcbf415e7a0 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcbf40cbb50 con 0x7fcbf40cbea0 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49744/0 (socket says 172.21.15.16:49744) 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 -- 172.21.15.16:0/787902281 learned_addr learned my addr 172.21.15.16:0/787902281 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf2800640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 0x7fcbf40c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbe9400640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40cbea0 0x7fcbf40c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 -- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40cbea0 msgr2=0x7fcbf40c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40cbea0 0x7fcbf40c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 -- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 msgr2=0x7fcbf40c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 0x7fcbf40c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 -- 172.21.15.16:0/787902281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf415a3c0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf2800640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 0x7fcbf40c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf1e00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e900 tx=0x7fcbe400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4017070 con 0x7fcbf40c80f0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe400ca00 con 0x7fcbf40c80f0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400cdf0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf4152d20 con 0x7fcbf40c80f0 2024-04-25T10:38:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf415c310 con 0x7fcbf40c80f0 2024-04-25T10:38:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.756+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf4050750 con 0x7fcbf40c80f0 2024-04-25T10:38:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.760+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcbe401a070 con 0x7fcbf40c80f0 2024-04-25T10:38:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.760+0000 7fcbeaa00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 0x7fcbcc071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.760+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fcbe408f400 con 0x7fcbf40c80f0 2024-04-25T10:38:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.760+0000 7fcbe9400640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 0x7fcbcc071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.760+0000 7fcbe9400640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 0x7fcbcc071ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0b2000 tx=0x7fcbdc0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.764+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcbe405c6e0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.932+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcbf41486b0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.932+0000 7fcbeaa00640 1 -- 172.21.15.16:0/787902281 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fcbe405bfe0 con 0x7fcbf40c80f0 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: { 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-25T10:38:55.936 INFO:teuthology.orchestra.run.smithi016.stdout:] 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 msgr2=0x7fcbcc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 0x7fcbcc071ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0b2000 tx=0x7fcbdc0aa070 comp rx=0 tx=0).stop 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 msgr2=0x7fcbf40ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400e900 tx=0x7fcbe400edc0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 shutdown_connections 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcbcc06f5a0 0x7fcbcc071ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcbf415e7a0 0x7fcbf40c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcbf40cbea0 0x7fcbf40c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 --2- 172.21.15.16:0/787902281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbf40c80f0 0x7fcbf40ce8e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:55.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 >> 172.21.15.16:0/787902281 conn(0x7fcbf4073160 msgr2=0x7fcbf4158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:55.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 shutdown_connections 2024-04-25T10:38:55.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:55.936+0000 7fcbf8c00640 1 -- 172.21.15.16:0/787902281 wait complete. 2024-04-25T10:38:55.958 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:38:55.958 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:38:56.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 Processor -- start 2024-04-25T10:38:56.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 -- start start 2024-04-25T10:38:56.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcef0143b20 0x7fcef015f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:56.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef00cda90 con 0x7fcef0144070 2024-04-25T10:38:56.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef00cdd70 con 0x7fcef015ae80 2024-04-25T10:38:56.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcef7200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcef00ce050 con 0x7fcef0143b20 2024-04-25T10:38:56.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fceefe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcef0143b20 0x7fcef015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:56.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcee7e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcef0144070 0x7fcef00c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37890/0 (socket says 172.21.15.16:37890) 2024-04-25T10:38:56.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fcee7e00640 1 -- 172.21.15.16:0/2648323948 learned_addr learned my addr 172.21.15.16:0/2648323948 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fceefe00640 1 -- 172.21.15.16:0/2648323948 >> v1:172.21.15.186:6789/0 conn(0x7fcef015ae80 legacy=0x7fcef0165800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fceefe00640 1 -- 172.21.15.16:0/2648323948 >> v1:172.21.15.16:6789/0 conn(0x7fcef0144070 legacy=0x7fcef00c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fceefe00640 1 -- 172.21.15.16:0/2648323948 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef015e5a0 con 0x7fcef0143b20 2024-04-25T10:38:56.117 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.112+0000 7fceef400640 1 -- 172.21.15.16:0/2648323948 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110840210 0 0) 0x7fcef00cda90 con 0x7fcef0144070 2024-04-25T10:38:56.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fceefe00640 1 --2- 172.21.15.16:0/2648323948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0143b20 0x7fcef015f080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcef00ce1d0 tx=0x7fcee001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24acbfbc800d8ae8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:56.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fceef400640 1 -- 172.21.15.16:0/2648323948 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee00a7070 con 0x7fcef0143b20 2024-04-25T10:38:56.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fceef400640 1 -- 172.21.15.16:0/2648323948 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee00b0070 con 0x7fcef0143b20 2024-04-25T10:38:56.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fceef400640 1 -- 172.21.15.16:0/2648323948 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee00ab8d0 con 0x7fcef0143b20 2024-04-25T10:38:56.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 -- 172.21.15.16:0/2648323948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0143b20 msgr2=0x7fcef015f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:56.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 --2- 172.21.15.16:0/2648323948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0143b20 0x7fcef015f080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcef00ce1d0 tx=0x7fcee001c560 comp rx=0 tx=0).stop 2024-04-25T10:38:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 -- 172.21.15.16:0/2648323948 shutdown_connections 2024-04-25T10:38:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 --2- 172.21.15.16:0/2648323948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0143b20 0x7fcef015f080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 -- 172.21.15.16:0/2648323948 >> 172.21.15.16:0/2648323948 conn(0x7fcef006cc70 msgr2=0x7fcef00cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 -- 172.21.15.16:0/2648323948 shutdown_connections 2024-04-25T10:38:56.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.116+0000 7fcef7200640 1 -- 172.21.15.16:0/2648323948 wait complete. 2024-04-25T10:38:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 Processor -- start 2024-04-25T10:38:56.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 -- start start 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 0x7fcef01409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcef015ae80 0x7fcef01f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcef01438e0 con 0x7fcef0144070 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcef0143760 con 0x7fcef0143b20 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef7200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcef0169740 con 0x7fcef015ae80 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:56.125 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49760/0 (socket says 172.21.15.16:49760) 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 -- 172.21.15.16:0/3589052046 learned_addr learned my addr 172.21.15.16:0/3589052046 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fceefe00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 0x7fcef01409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcef5200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcef015ae80 0x7fcef01f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 -- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcef015ae80 msgr2=0x7fcef01f9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcef015ae80 0x7fcef01f9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 -- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 msgr2=0x7fcef01409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 0x7fcef01409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 -- 172.21.15.16:0/3589052046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef0163b70 con 0x7fcef0144070 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fceefe00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 0x7fcef01409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:56.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.120+0000 7fcee7e00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fced800c4a0 tx=0x7fced800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8018070 con 0x7fcef0144070 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced80074e0 con 0x7fcef0144070 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8004a10 con 0x7fcef0144070 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef0163e00 con 0x7fcef0144070 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef01640a0 con 0x7fcef0144070 2024-04-25T10:38:56.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef0050750 con 0x7fcef0144070 2024-04-25T10:38:56.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fced8004c70 con 0x7fcef0144070 2024-04-25T10:38:56.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 0x7fcec8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:56.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fced808e190 con 0x7fcef0144070 2024-04-25T10:38:56.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.124+0000 7fceefe00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 0x7fcec8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:56.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.128+0000 7fceefe00640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 0x7fcec8071ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcee00af000 tx=0x7fcee00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:56.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.128+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcef0163e00 con 0x7fcef0144070 2024-04-25T10:38:56.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:56.300+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcef01f90d0 con 0x7fcef0144070 2024-04-25T10:38:57.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.300+0000 7fceecc00640 1 -- 172.21.15.16:0/3589052046 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fced805b380 con 0x7fcef0144070 2024-04-25T10:38:57.304 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 msgr2=0x7fcec8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 0x7fcec8071ab0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcee00af000 tx=0x7fcee00a7000 comp rx=0 tx=0).stop 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 msgr2=0x7fcef01fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fced800c4a0 tx=0x7fced800c960 comp rx=0 tx=0).stop 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 shutdown_connections 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcec806f5a0 0x7fcec8071ab0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcef015ae80 0x7fcef01f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcef0144070 0x7fcef01fd070 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 --2- 172.21.15.16:0/3589052046 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcef0143b20 0x7fcef01409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 >> 172.21.15.16:0/3589052046 conn(0x7fcef006cc70 msgr2=0x7fcef0158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 shutdown_connections 2024-04-25T10:38:57.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.304+0000 7fcef7200640 1 -- 172.21.15.16:0/3589052046 wait complete. 2024-04-25T10:38:57.339 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T10:38:57.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 Processor -- start 2024-04-25T10:38:57.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 -- start start 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39b415bbe0 0x7f39b40cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 0x7f39b40c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f39b415f430 con 0x7f39b415bbe0 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f39b415e8b0 con 0x7f39b40cc700 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39bc000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f39b415eb90 con 0x7f39b40c67e0 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39b415bbe0 0x7f39b40cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f39b415bbe0 0x7f39b40cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49762/0 (socket says 172.21.15.16:49762) 2024-04-25T10:38:57.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 -- 172.21.15.16:0/2489996183 learned_addr learned my addr 172.21.15.16:0/2489996183 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b9600640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39ba000640 1 --2- 172.21.15.16:0/2489996183 >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 0x7f39b40c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 -- 172.21.15.16:0/2489996183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 msgr2=0x7f39b415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 -- 172.21.15.16:0/2489996183 >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 msgr2=0x7f39b40c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 --2- 172.21.15.16:0/2489996183 >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 0x7f39b40c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b8c00640 1 -- 172.21.15.16:0/2489996183 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b415ee70 con 0x7f39b415bbe0 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39ba000640 1 --2- 172.21.15.16:0/2489996183 >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 0x7f39b40c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:57.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.500+0000 7f39b9600640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:57.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39b8c00640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b40cc1c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39b408d3a0 tx=0x7f39a001ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e21bcf2597312ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:57.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39b3e00640 1 -- 172.21.15.16:0/2489996183 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a00b5070 con 0x7f39b415bbe0 2024-04-25T10:38:57.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39b3e00640 1 -- 172.21.15.16:0/2489996183 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a00a8af0 con 0x7f39b415bbe0 2024-04-25T10:38:57.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39b3e00640 1 -- 172.21.15.16:0/2489996183 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a00b0440 con 0x7f39b415bbe0 2024-04-25T10:38:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 -- 172.21.15.16:0/2489996183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 msgr2=0x7f39b40cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b40cc1c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39b408d3a0 tx=0x7f39a001ee30 comp rx=0 tx=0).stop 2024-04-25T10:38:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 -- 172.21.15.16:0/2489996183 shutdown_connections 2024-04-25T10:38:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 --2- 172.21.15.16:0/2489996183 >> v2:172.21.15.186:3300/0 conn(0x7f39b40cc700 0x7f39b40c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b40cc1c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 --2- 172.21.15.16:0/2489996183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 -- 172.21.15.16:0/2489996183 >> 172.21.15.16:0/2489996183 conn(0x7f39b40732e0 msgr2=0x7f39b40736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 -- 172.21.15.16:0/2489996183 shutdown_connections 2024-04-25T10:38:57.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.504+0000 7f39bc000640 1 -- 172.21.15.16:0/2489996183 wait complete. 2024-04-25T10:38:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 Processor -- start 2024-04-25T10:38:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 -- start start 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b41562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39b40cc700 0x7f39b4145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f39b415e4e0 con 0x7f39b415bbe0 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f39b415b180 con 0x7f39b40cc700 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39bc000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f39b415e660 con 0x7f39b40c67e0 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39ba000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.508+0000 7f39ba000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49778/0 (socket says 172.21.15.16:49778) 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 -- 172.21.15.16:0/1688003947 learned_addr learned my addr 172.21.15.16:0/1688003947 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b8c00640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39b40cc700 0x7f39b4145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b9600640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b41562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 -- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 msgr2=0x7f39b41562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:57.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b41562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 -- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39b40cc700 msgr2=0x7f39b4145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:57.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39b40cc700 0x7f39b4145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:57.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 -- 172.21.15.16:0/1688003947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b41f71e0 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39ba000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007f10 tx=0x7f39ac00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac01a070 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac015620 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac015a10 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b4153170 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b41f73f0 con 0x7f39b415bbe0 2024-04-25T10:38:57.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b41467d0 con 0x7f39b415bbe0 2024-04-25T10:38:57.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.512+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39ac01d070 con 0x7f39b415bbe0 2024-04-25T10:38:57.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.516+0000 7f39b1600640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 0x7f3990071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:57.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.516+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f39ac08ff00 con 0x7f39b415bbe0 2024-04-25T10:38:57.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.516+0000 7f39b9600640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 0x7f3990071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:57.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.516+0000 7f39b9600640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 0x7f3990071ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c8d0 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:57.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.520+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39b41467d0 con 0x7f39b415bbe0 2024-04-25T10:38:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:57.684+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f39b4000920 con 0x7f39b415bbe0 2024-04-25T10:38:58.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.308+0000 7f39b1600640 1 -- 172.21.15.16:0/1688003947 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f39ac024070 con 0x7f39b415bbe0 2024-04-25T10:38:58.313 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2024-04-25T10:38:58.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 msgr2=0x7f3990071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 0x7f3990071ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39a800c8d0 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2024-04-25T10:38:58.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 msgr2=0x7f39b415d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007f10 tx=0x7f39ac00d4a0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 shutdown_connections 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f399006f5a0 0x7f3990071ab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f39b415bbe0 0x7f39b415d510 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f39b40cc700 0x7f39b4145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 --2- 172.21.15.16:0/1688003947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f39b40c67e0 0x7f39b41562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 >> 172.21.15.16:0/1688003947 conn(0x7f39b40732e0 msgr2=0x7f39b40cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:58.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.312+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 shutdown_connections 2024-04-25T10:38:58.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.316+0000 7f39bc000640 1 -- 172.21.15.16:0/1688003947 wait complete. 2024-04-25T10:38:58.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:38:58.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.512+0000 7f6f17800640 1 Processor -- start 2024-04-25T10:38:58.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.512+0000 7f6f17800640 1 -- start start 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f17800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 0x7f6f10159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f17800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f100cd150 0x7f6f100cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f17800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f100cdaa0 con 0x7f6f100c30c0 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f17800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1015e360 con 0x7f6f100cd150 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f17800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6f1015dac0 con 0x7f6f1015df50 2024-04-25T10:38:58.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f100cd150 0x7f6f100cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f100cd150 0x7f6f100cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49780/0 (socket says 172.21.15.16:49780) 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 -- 172.21.15.16:0/2827408139 learned_addr learned my addr 172.21.15.16:0/2827408139 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f14e00640 1 --2- 172.21.15.16:0/2827408139 >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 0x7f6f10159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 -- 172.21.15.16:0/2827408139 >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 msgr2=0x7f6f10159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 --2- 172.21.15.16:0/2827408139 >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 0x7f6f10159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 -- 172.21.15.16:0/2827408139 >> v1:172.21.15.16:6789/0 conn(0x7f6f100c30c0 legacy=0x7f6f100c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f15800640 1 -- 172.21.15.16:0/2827408139 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1015d4b0 con 0x7f6f100cd150 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f14e00640 1 --2- 172.21.15.16:0/2827408139 >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 0x7f6f10159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:38:58.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.516+0000 7f6f0f400640 1 -- 172.21.15.16:0/2827408139 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641110125 0 0) 0x7f6efc0011b0 con 0x7f6f100c30c0 2024-04-25T10:38:58.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f15800640 1 --2- 172.21.15.16:0/2827408139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100cd150 0x7f6f100cd560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f10073560 tx=0x7f6f0801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0a7952351d5f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:58.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f0f400640 1 -- 172.21.15.16:0/2827408139 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f080a58d0 con 0x7f6f100cd150 2024-04-25T10:38:58.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f0f400640 1 -- 172.21.15.16:0/2827408139 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f080a5a70 con 0x7f6f100cd150 2024-04-25T10:38:58.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f0f400640 1 -- 172.21.15.16:0/2827408139 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f080a5e40 con 0x7f6f100cd150 2024-04-25T10:38:58.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 -- 172.21.15.16:0/2827408139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100cd150 msgr2=0x7f6f100cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 --2- 172.21.15.16:0/2827408139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100cd150 0x7f6f100cd560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f10073560 tx=0x7f6f0801caf0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 -- 172.21.15.16:0/2827408139 shutdown_connections 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 --2- 172.21.15.16:0/2827408139 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100cd150 0x7f6f100cd560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 --2- 172.21.15.16:0/2827408139 >> v2:172.21.15.186:3300/0 conn(0x7f6f1015df50 0x7f6f10159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 -- 172.21.15.16:0/2827408139 >> 172.21.15.16:0/2827408139 conn(0x7f6f10074930 msgr2=0x7f6f1006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 -- 172.21.15.16:0/2827408139 shutdown_connections 2024-04-25T10:38:58.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.520+0000 7f6f17800640 1 -- 172.21.15.16:0/2827408139 wait complete. 2024-04-25T10:38:58.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 Processor -- start 2024-04-25T10:38:58.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- start start 2024-04-25T10:38:58.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 0x7f6f10145fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 0x7f6f100c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100c34d0 con 0x7f6f100c30c0 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6f100c5d80 con 0x7f6f100cd150 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6f100c3650 con 0x7f6f1015df50 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49786/0 (socket says 172.21.15.16:49786) 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 -- 172.21.15.16:0/574408462 learned_addr learned my addr 172.21.15.16:0/574408462 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f0fe00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 0x7f6f10145fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f15800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 0x7f6f100c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 -- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 msgr2=0x7f6f100c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 0x7f6f100c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 -- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 msgr2=0x7f6f10145fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 0x7f6f10145fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:58.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 -- 172.21.15.16:0/574408462 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1014a0a0 con 0x7f6f100c30c0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f0fe00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 0x7f6f10145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f15800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 0x7f6f100c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f14e00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e850 tx=0x7f6f0400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f04017070 con 0x7f6f100c30c0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0400c8d0 con 0x7f6f100c30c0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400f040 con 0x7f6f100c30c0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1015b8a0 con 0x7f6f100c30c0 2024-04-25T10:38:58.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.524+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1014b050 con 0x7f6f100c30c0 2024-04-25T10:38:58.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f10050750 con 0x7f6f100c30c0 2024-04-25T10:38:58.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6f0401a070 con 0x7f6f100c30c0 2024-04-25T10:38:58.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f0cc00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 0x7f6eec071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:58.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f6f0408ef90 con 0x7f6f100c30c0 2024-04-25T10:38:58.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f0fe00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 0x7f6eec071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:58.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.528+0000 7f6f0fe00640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 0x7f6eec071ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f101f0070 tx=0x7f6efc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:58.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.532+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f0405be00 con 0x7f6f100c30c0 2024-04-25T10:38:58.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:58.736+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6f10157be0 con 0x7f6f100c30c0 2024-04-25T10:38:59.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.324+0000 7f6f0cc00640 1 -- 172.21.15.16:0/574408462 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6f0405b700 con 0x7f6f100c30c0 2024-04-25T10:38:59.332 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T10:38:59.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 msgr2=0x7f6eec071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 0x7f6eec071ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f101f0070 tx=0x7f6efc009040 comp rx=0 tx=0).stop 2024-04-25T10:38:59.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 msgr2=0x7f6f1014ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e850 tx=0x7f6f0400ed10 comp rx=0 tx=0).stop 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 shutdown_connections 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6eec06f5a0 0x7f6eec071ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f1015df50 0x7f6f100c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f100cd150 0x7f6f10145fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 --2- 172.21.15.16:0/574408462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f100c30c0 0x7f6f1014ed00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 >> 172.21.15.16:0/574408462 conn(0x7f6f10074930 msgr2=0x7f6f101629c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:59.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.332+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 shutdown_connections 2024-04-25T10:38:59.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.336+0000 7f6f17800640 1 -- 172.21.15.16:0/574408462 wait complete. 2024-04-25T10:38:59.381 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T10:38:59.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T10:38:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.536+0000 7fd633200640 1 Processor -- start 2024-04-25T10:38:59.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.536+0000 7fd633200640 1 -- start start 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd633200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd62c0c5200 0x7fd62c165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd633200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0cd8f0 con 0x7fd62c0c46e0 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd633200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0cdbb0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd633200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0c8690 con 0x7fd62c0c5200 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd62b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd62c0c46e0 0x7fd62c0c4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37912/0 (socket says 172.21.15.16:37912) 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd62b400640 1 -- 172.21.15.16:0/662824846 learned_addr learned my addr 172.21.15.16:0/662824846 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:38:59.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd631200640 1 --2- 172.21.15.16:0/662824846 >> v2:172.21.15.16:3300/0 conn(0x7fd62c0c5200 0x7fd62c165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd62aa00640 1 -- 172.21.15.16:0/662824846 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372112109 0 0) 0x7fd62c0cd8f0 con 0x7fd62c0c46e0 2024-04-25T10:38:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd62aa00640 1 -- 172.21.15.16:0/662824846 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6100035c0 con 0x7fd62c0c46e0 2024-04-25T10:38:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd631200640 1 -- 172.21.15.16:0/662824846 >> v1:172.21.15.186:6789/0 conn(0x7fd62c0c8b20 legacy=0x7fd62c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd631200640 1 -- 172.21.15.16:0/662824846 >> v1:172.21.15.16:6789/0 conn(0x7fd62c0c46e0 legacy=0x7fd62c0c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.540+0000 7fd631200640 1 -- 172.21.15.16:0/662824846 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0c7d60 con 0x7fd62c0c5200 2024-04-25T10:38:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd631200640 1 --2- 172.21.15.16:0/662824846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c5200 0x7fd62c165730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd624009ee0 tx=0x7fd62401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423bc6bfbc0011e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd62aa00640 1 -- 172.21.15.16:0/662824846 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240b2070 con 0x7fd62c0c5200 2024-04-25T10:38:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd62aa00640 1 -- 172.21.15.16:0/662824846 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6240a5b40 con 0x7fd62c0c5200 2024-04-25T10:38:59.547 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd62aa00640 1 -- 172.21.15.16:0/662824846 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240ad440 con 0x7fd62c0c5200 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 -- 172.21.15.16:0/662824846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c5200 msgr2=0x7fd62c165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 --2- 172.21.15.16:0/662824846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c5200 0x7fd62c165730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd624009ee0 tx=0x7fd62401ca70 comp rx=0 tx=0).stop 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 -- 172.21.15.16:0/662824846 shutdown_connections 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 --2- 172.21.15.16:0/662824846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c5200 0x7fd62c165730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 -- 172.21.15.16:0/662824846 >> 172.21.15.16:0/662824846 conn(0x7fd62c06cc70 msgr2=0x7fd62c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 -- 172.21.15.16:0/662824846 shutdown_connections 2024-04-25T10:38:59.548 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.544+0000 7fd633200640 1 -- 172.21.15.16:0/662824846 wait complete. 2024-04-25T10:38:59.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 Processor -- start 2024-04-25T10:38:59.550 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- start start 2024-04-25T10:38:59.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 0x7fd62c144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:59.552 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd62c0c5200 0x7fd62c1fe880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c154000 con 0x7fd62c0c8b20 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0c9a10 con 0x7fd62c0c5200 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c154180 con 0x7fd62c0c46e0 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49804/0 (socket says 172.21.15.16:49804) 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 -- 172.21.15.16:0/1690222851 learned_addr learned my addr 172.21.15.16:0/1690222851 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd62be00640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 0x7fd62c144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd62b400640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd62c0c5200 0x7fd62c1fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 -- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 msgr2=0x7fd62c144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 0x7fd62c144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 -- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd62c0c5200 msgr2=0x7fd62c1fe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:38:59.553 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd62c0c5200 0x7fd62c1fe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:38:59.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 -- 172.21.15.16:0/1690222851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c14f8d0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd62be00640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 0x7fd62c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:38:59.554 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd631200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd624019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240b2050 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6240be070 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624009490 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c1fedc0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.548+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c1547c0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.552+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c14fed0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.552+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd6240c3460 con 0x7fd62c0c8b20 2024-04-25T10:38:59.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.552+0000 7fd623e00640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 0x7fd604071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:38:59.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.552+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd62412a8f0 con 0x7fd62c0c8b20 2024-04-25T10:38:59.557 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.552+0000 7fd62be00640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 0x7fd604071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:38:59.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.556+0000 7fd62be00640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 0x7fd604071ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0016e0 tx=0x7fd61c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:38:59.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.564+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd624016660 con 0x7fd62c0c8b20 2024-04-25T10:38:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:38:59.740+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd62c1fef90 con 0x7fd62c0c8b20 2024-04-25T10:39:00.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd623e00640 1 -- 172.21.15.16:0/1690222851 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fd6240f77f0 con 0x7fd62c0c8b20 2024-04-25T10:39:00.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 msgr2=0x7fd604071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 0x7fd604071ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0016e0 tx=0x7fd61c009040 comp rx=0 tx=0).stop 2024-04-25T10:39:00.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 msgr2=0x7fd62c1459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6240b0040 tx=0x7fd624019810 comp rx=0 tx=0).stop 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 shutdown_connections 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd60406f5a0 0x7fd604071ab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd62c0c8b20 0x7fd62c1459d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd62c0c5200 0x7fd62c1fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 --2- 172.21.15.16:0/1690222851 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd62c0c46e0 0x7fd62c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 >> 172.21.15.16:0/1690222851 conn(0x7fd62c06cc70 msgr2=0x7fd62c159060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 shutdown_connections 2024-04-25T10:39:00.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.316+0000 7fd633200640 1 -- 172.21.15.16:0/1690222851 wait complete. 2024-04-25T10:39:00.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:39:00.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 Processor -- start 2024-04-25T10:39:00.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 -- start start 2024-04-25T10:39:00.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f21d81553a0 0x7f21d80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:00.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d80c7720 con 0x7f21d80c4460 2024-04-25T10:39:00.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d80c6620 con 0x7f21d8163980 2024-04-25T10:39:00.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21dca00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f21d81557b0 con 0x7f21d81553a0 2024-04-25T10:39:00.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21cfe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f21d80c4460 0x7f21d80cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37920/0 (socket says 172.21.15.16:37920) 2024-04-25T10:39:00.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21cfe00640 1 -- 172.21.15.16:0/890323492 learned_addr learned my addr 172.21.15.16:0/890323492 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:00.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.508+0000 7f21d5e00640 1 --2- 172.21.15.16:0/890323492 >> v2:172.21.15.186:3300/0 conn(0x7f21d81553a0 0x7f21d80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:00.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149348500 0 0) 0x7f21d80c7720 con 0x7f21d80c4460 2024-04-25T10:39:00.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21bc0035c0 con 0x7f21d80c4460 2024-04-25T10:39:00.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5e00640 1 -- 172.21.15.16:0/890323492 >> v1:172.21.15.186:6789/0 conn(0x7f21d8163980 legacy=0x7f21d8165da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5e00640 1 -- 172.21.15.16:0/890323492 >> v1:172.21.15.16:6789/0 conn(0x7f21d80c4460 legacy=0x7f21d80cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 548101549 0 0) 0x7f21bc0035c0 con 0x7f21d80c4460 2024-04-25T10:39:00.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5e00640 1 -- 172.21.15.16:0/890323492 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80c8f90 con 0x7f21d81553a0 2024-04-25T10:39:00.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5e00640 1 --2- 172.21.15.16:0/890323492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d81553a0 0x7f21d80c71e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=463475342324cba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:00.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.512+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c80b5070 con 0x7f21d81553a0 2024-04-25T10:39:00.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c80a8770 con 0x7f21d81553a0 2024-04-25T10:39:00.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21d5400640 1 -- 172.21.15.16:0/890323492 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00016d0 con 0x7f21d81553a0 2024-04-25T10:39:00.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- 172.21.15.16:0/890323492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d81553a0 msgr2=0x7f21d80c71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 --2- 172.21.15.16:0/890323492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d81553a0 0x7f21d80c71e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c801ecb0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- 172.21.15.16:0/890323492 shutdown_connections 2024-04-25T10:39:00.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 --2- 172.21.15.16:0/890323492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d81553a0 0x7f21d80c71e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- 172.21.15.16:0/890323492 >> 172.21.15.16:0/890323492 conn(0x7f21d8073160 msgr2=0x7f21d8073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:00.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- 172.21.15.16:0/890323492 shutdown_connections 2024-04-25T10:39:00.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- 172.21.15.16:0/890323492 wait complete. 2024-04-25T10:39:00.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 Processor -- start 2024-04-25T10:39:00.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.516+0000 7f21dca00640 1 -- start start 2024-04-25T10:39:00.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21d80c4460 0x7f21d814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:00.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 0x7f21d81f8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80c6d50 con 0x7f21d81553a0 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80c8d40 con 0x7f21d8163980 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f21d80c9250 con 0x7f21d80c4460 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49812/0 (socket says 172.21.15.16:49812) 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 -- 172.21.15.16:0/970646682 learned_addr learned my addr 172.21.15.16:0/970646682 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21d5e00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21d80c4460 0x7f21d814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21d6800640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 0x7f21d81f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 -- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21d80c4460 msgr2=0x7f21d814dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21d80c4460 0x7f21d814dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 -- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 msgr2=0x7f21d81f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:00.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 0x7f21d81f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 -- 172.21.15.16:0/970646682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d81f86b0 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21d6800640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 0x7f21d81f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21cfe00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c600 tx=0x7f21c000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0017070 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0005d30 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d81eb0e0 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00072b0 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d81eb680 con 0x7f21d81553a0 2024-04-25T10:39:00.525 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.520+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d8069d70 con 0x7f21d81553a0 2024-04-25T10:39:00.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.524+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f21c001a070 con 0x7f21d81553a0 2024-04-25T10:39:00.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.524+0000 7f21ce000640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 0x7f21b0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:00.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.524+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f21c008e910 con 0x7f21d81553a0 2024-04-25T10:39:00.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.524+0000 7f21d5e00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 0x7f21b0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:00.528 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.524+0000 7f21d5e00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 0x7f21b0071ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b2000 tx=0x7f21c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:00.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.528+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21c005afa0 con 0x7f21d81553a0 2024-04-25T10:39:00.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:00.696+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f21d81eb940 con 0x7f21d81553a0 2024-04-25T10:39:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.356+0000 7f21ce000640 1 -- 172.21.15.16:0/970646682 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f21c005f2a0 con 0x7f21d81553a0 2024-04-25T10:39:02.360 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data_ec' created 2024-04-25T10:39:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 msgr2=0x7f21b0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 0x7f21b0071ab0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b2000 tx=0x7f21c8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 msgr2=0x7f21d81eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.364 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c600 tx=0x7f21c000cac0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 shutdown_connections 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f21b006f5a0 0x7f21b0071ab0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f21d8163980 0x7f21d81f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21d81553a0 0x7f21d81eaa50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 --2- 172.21.15.16:0/970646682 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f21d80c4460 0x7f21d814dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 >> 172.21.15.16:0/970646682 conn(0x7f21d8073160 msgr2=0x7f21d8150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 shutdown_connections 2024-04-25T10:39:02.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.360+0000 7f21dca00640 1 -- 172.21.15.16:0/970646682 wait complete. 2024-04-25T10:39:02.399 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T10:39:02.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.556+0000 7f502ae00640 1 Processor -- start 2024-04-25T10:39:02.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.556+0000 7f502ae00640 1 -- start start 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f502ae00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f50240c8b20 0x7f50240c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f502ae00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50240c5200 0x7f5024164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f502ae00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50240cd8f0 con 0x7f50240c46e0 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f502ae00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f50240c8690 con 0x7f50240c5200 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f502ae00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f50240cdbb0 con 0x7f50240c8b20 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50240c5200 0x7f5024164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50240c5200 0x7f5024164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49824/0 (socket says 172.21.15.16:49824) 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 -- 172.21.15.16:0/2779468317 learned_addr learned my addr 172.21.15.16:0/2779468317 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5023e00640 1 --2- 172.21.15.16:0/2779468317 >> v2:172.21.15.186:3300/0 conn(0x7f50240c8b20 0x7f50240c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 -- 172.21.15.16:0/2779468317 >> v2:172.21.15.186:3300/0 conn(0x7f50240c8b20 msgr2=0x7f50240c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 --2- 172.21.15.16:0/2779468317 >> v2:172.21.15.186:3300/0 conn(0x7f50240c8b20 0x7f50240c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 -- 172.21.15.16:0/2779468317 >> v1:172.21.15.186:6789/0 conn(0x7f50240c46e0 legacy=0x7f50240c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.560+0000 7f5028e00640 1 -- 172.21.15.16:0/2779468317 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50240c7d60 con 0x7f50240c5200 2024-04-25T10:39:02.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f5028e00640 1 --2- 172.21.15.16:0/2779468317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c5200 0x7f5024164720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5024073630 tx=0x7f501c01f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e954039f70276c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:02.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f5023400640 1 -- 172.21.15.16:0/2779468317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c0b4070 con 0x7f50240c5200 2024-04-25T10:39:02.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f5023400640 1 -- 172.21.15.16:0/2779468317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c007430 con 0x7f50240c5200 2024-04-25T10:39:02.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f5023400640 1 -- 172.21.15.16:0/2779468317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c007840 con 0x7f50240c5200 2024-04-25T10:39:02.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 -- 172.21.15.16:0/2779468317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c5200 msgr2=0x7f5024164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 --2- 172.21.15.16:0/2779468317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c5200 0x7f5024164720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5024073630 tx=0x7f501c01f2f0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 -- 172.21.15.16:0/2779468317 shutdown_connections 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 --2- 172.21.15.16:0/2779468317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c5200 0x7f5024164720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 --2- 172.21.15.16:0/2779468317 >> v2:172.21.15.186:3300/0 conn(0x7f50240c8b20 0x7f50240c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 -- 172.21.15.16:0/2779468317 >> 172.21.15.16:0/2779468317 conn(0x7f502406cc70 msgr2=0x7f50240cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 -- 172.21.15.16:0/2779468317 shutdown_connections 2024-04-25T10:39:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.564+0000 7f502ae00640 1 -- 172.21.15.16:0/2779468317 wait complete. 2024-04-25T10:39:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 Processor -- start 2024-04-25T10:39:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- start start 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 0x7f5024155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50240c8b20 0x7f50241561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f502415ac40 con 0x7f50240c46e0 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f50240c8320 con 0x7f50240c8b20 2024-04-25T10:39:02.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f50240c9470 con 0x7f50240c5200 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49838/0 (socket says 172.21.15.16:49838) 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 -- 172.21.15.16:0/4050182533 learned_addr learned my addr 172.21.15.16:0/4050182533 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f501b400640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 0x7f5024155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5028e00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50240c8b20 0x7f50241561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 -- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 msgr2=0x7f5024155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 0x7f5024155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 -- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50240c8b20 msgr2=0x7f50241561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50240c8b20 0x7f50241561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 -- 172.21.15.16:0/4050182533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50241588d0 con 0x7f50240c46e0 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f501b400640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 0x7f5024155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:02.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5023e00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501400e9b0 tx=0x7f501400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014017070 con 0x7f50240c46e0 2024-04-25T10:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501400c9a0 con 0x7f50240c46e0 2024-04-25T10:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5024158b90 con 0x7f50240c46e0 2024-04-25T10:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501400cd50 con 0x7f50240c46e0 2024-04-25T10:39:02.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.568+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5024148290 con 0x7f50240c46e0 2024-04-25T10:39:02.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.572+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5024050750 con 0x7f50240c46e0 2024-04-25T10:39:02.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.572+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f501401a070 con 0x7f50240c46e0 2024-04-25T10:39:02.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.572+0000 7f5020c00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 0x7f4ffc071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:02.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.572+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f501408f720 con 0x7f50240c46e0 2024-04-25T10:39:02.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.576+0000 7f501b400640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 0x7f4ffc071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:02.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.576+0000 7f501b400640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 0x7f4ffc071ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50241473b0 tx=0x7f500c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:02.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.580+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f501405c270 con 0x7f50240c46e0 2024-04-25T10:39:02.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:02.744+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f502406e1f0 con 0x7f50240c46e0 2024-04-25T10:39:03.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.364+0000 7f5020c00640 1 -- 172.21.15.16:0/4050182533 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f501405bb70 con 0x7f50240c46e0 2024-04-25T10:39:03.369 INFO:teuthology.orchestra.run.smithi016.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T10:39:03.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 msgr2=0x7f4ffc071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 0x7f4ffc071ae0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50241473b0 tx=0x7f500c009040 comp rx=0 tx=0).stop 2024-04-25T10:39:03.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 msgr2=0x7f50241434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f501400e9b0 tx=0x7f501400ee70 comp rx=0 tx=0).stop 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 shutdown_connections 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4ffc06f5d0 0x7f4ffc071ae0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50240c8b20 0x7f50241561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f50240c5200 0x7f5024155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 --2- 172.21.15.16:0/4050182533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50240c46e0 0x7f50241434b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 >> 172.21.15.16:0/4050182533 conn(0x7f502406cc70 msgr2=0x7f50240cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 shutdown_connections 2024-04-25T10:39:03.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.368+0000 7f502ae00640 1 -- 172.21.15.16:0/4050182533 wait complete. 2024-04-25T10:39:03.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T10:39:03.452 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T10:39:03.448+0000 7f947610d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:39:03.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.572+0000 7f8b67000640 1 Processor -- start 2024-04-25T10:39:03.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 -- start start 2024-04-25T10:39:03.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8b600c9ed0 0x7f8b600c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b600c6b50 0x7f8b600cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b600ca430 con 0x7f8b60154320 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f8b600c74b0 con 0x7f8b600c6b50 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b67000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8b600c4b80 con 0x7f8b600c9ed0 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b600c6b50 0x7f8b600cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8b600c6b50 0x7f8b600cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49840/0 (socket says 172.21.15.16:49840) 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 -- 172.21.15.16:0/824571453 learned_addr learned my addr 172.21.15.16:0/824571453 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:03.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b57e00640 1 --2- 172.21.15.16:0/824571453 >> v2:172.21.15.186:3300/0 conn(0x7f8b600c9ed0 0x7f8b600c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 -- 172.21.15.16:0/824571453 >> v2:172.21.15.186:3300/0 conn(0x7f8b600c9ed0 msgr2=0x7f8b600c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:03.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 --2- 172.21.15.16:0/824571453 >> v2:172.21.15.186:3300/0 conn(0x7f8b600c9ed0 0x7f8b600c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 -- 172.21.15.16:0/824571453 >> v1:172.21.15.186:6789/0 conn(0x7f8b60154320 legacy=0x7f8b600c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.576+0000 7f8b65000640 1 -- 172.21.15.16:0/824571453 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b600c4e60 con 0x7f8b600c6b50 2024-04-25T10:39:03.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b65000640 1 --2- 172.21.15.16:0/824571453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b600c6b50 0x7f8b600cac50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b600733a0 tx=0x7f8b5801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98fb0682ad249d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:03.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b5f400640 1 -- 172.21.15.16:0/824571453 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800b2d0 con 0x7f8b600c6b50 2024-04-25T10:39:03.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b5f400640 1 -- 172.21.15.16:0/824571453 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5800b470 con 0x7f8b600c6b50 2024-04-25T10:39:03.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b5f400640 1 -- 172.21.15.16:0/824571453 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a7c10 con 0x7f8b600c6b50 2024-04-25T10:39:03.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 -- 172.21.15.16:0/824571453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b600c6b50 msgr2=0x7f8b600cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 --2- 172.21.15.16:0/824571453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b600c6b50 0x7f8b600cac50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b600733a0 tx=0x7f8b5801ed10 comp rx=0 tx=0).stop 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 -- 172.21.15.16:0/824571453 shutdown_connections 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 --2- 172.21.15.16:0/824571453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b600c6b50 0x7f8b600cac50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 --2- 172.21.15.16:0/824571453 >> v2:172.21.15.186:3300/0 conn(0x7f8b600c9ed0 0x7f8b600c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 -- 172.21.15.16:0/824571453 >> 172.21.15.16:0/824571453 conn(0x7f8b6006dd80 msgr2=0x7f8b60072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 -- 172.21.15.16:0/824571453 shutdown_connections 2024-04-25T10:39:03.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.580+0000 7f8b67000640 1 -- 172.21.15.16:0/824571453 wait complete. 2024-04-25T10:39:03.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 Processor -- start 2024-04-25T10:39:03.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 -- start start 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 0x7f8b600c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b600c9ed0 0x7f8b60150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6006d290 con 0x7f8b60154320 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6006d110 con 0x7f8b600c6b50 2024-04-25T10:39:03.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b67000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8b6006d410 con 0x7f8b600c9ed0 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49846/0 (socket says 172.21.15.16:49846) 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 -- 172.21.15.16:0/2469768839 learned_addr learned my addr 172.21.15.16:0/2469768839 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b5fe00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 0x7f8b600c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b57e00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b600c9ed0 0x7f8b60150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 -- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b600c9ed0 msgr2=0x7f8b60150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b600c9ed0 0x7f8b60150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 -- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 msgr2=0x7f8b600c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 0x7f8b600c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b65000640 1 -- 172.21.15.16:0/2469768839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b60150bc0 con 0x7f8b60154320 2024-04-25T10:39:03.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.584+0000 7f8b5fe00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 0x7f8b600c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b65000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801b920 tx=0x7f8b5801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58009840 con 0x7f8b60154320 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b580be070 con 0x7f8b60154320 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6015c040 con 0x7f8b60154320 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58009c60 con 0x7f8b60154320 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6014fba0 con 0x7f8b60154320 2024-04-25T10:39:03.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60050750 con 0x7f8b60154320 2024-04-25T10:39:03.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b580b6070 con 0x7f8b60154320 2024-04-25T10:39:03.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 0x7f8b38071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:03.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.588+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f8b5812a630 con 0x7f8b60154320 2024-04-25T10:39:03.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.592+0000 7f8b5fe00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 0x7f8b38071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:03.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.592+0000 7f8b5fe00640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 0x7f8b38071ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b50001700 tx=0x7f8b50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:03.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.596+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b58018900 con 0x7f8b60154320 2024-04-25T10:39:03.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:03.796+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f8b6006f0a0 con 0x7f8b60154320 2024-04-25T10:39:04.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.380+0000 7f8b5cc00640 1 -- 172.21.15.16:0/2469768839 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f8b580f7240 con 0x7f8b60154320 2024-04-25T10:39:04.385 INFO:teuthology.orchestra.run.smithi016.stderr:added data pool 4 to fsmap 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 msgr2=0x7f8b38071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 0x7f8b38071ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b50001700 tx=0x7f8b50009040 comp rx=0 tx=0).stop 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 msgr2=0x7f8b601ff310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b5801b920 tx=0x7f8b5801bab0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 shutdown_connections 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f8b3806f5a0 0x7f8b38071ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8b60154320 0x7f8b601ff310 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8b600c9ed0 0x7f8b60150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 --2- 172.21.15.16:0/2469768839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b600c6b50 0x7f8b600c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 >> 172.21.15.16:0/2469768839 conn(0x7f8b6006dd80 msgr2=0x7f8b60162950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:04.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 shutdown_connections 2024-04-25T10:39:04.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.384+0000 7f8b67000640 1 -- 172.21.15.16:0/2469768839 wait complete. 2024-04-25T10:39:04.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:04.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.560+0000 7f542f200640 1 Processor -- start 2024-04-25T10:39:04.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.560+0000 7f542f200640 1 -- start start 2024-04-25T10:39:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542f200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f54300c44b0 0x7f54301541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542f200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f543015d6b0 0x7f543015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54300c5510 con 0x7f54300c6780 2024-04-25T10:39:04.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542f200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f54300c3b50 con 0x7f543015d6b0 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542f200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f543006d780 con 0x7f54300c44b0 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f543015d6b0 0x7f543015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542e800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f54300c6780 0x7f54300c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:37928/0 (socket says 172.21.15.16:37928) 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542e800640 1 -- 172.21.15.16:0/3546030840 learned_addr learned my addr 172.21.15.16:0/3546030840 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542de00640 1 --2- 172.21.15.16:0/3546030840 >> v2:172.21.15.186:3300/0 conn(0x7f54300c44b0 0x7f54301541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 -- 172.21.15.16:0/3546030840 >> v2:172.21.15.186:3300/0 conn(0x7f54300c44b0 msgr2=0x7f54301541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 --2- 172.21.15.16:0/3546030840 >> v2:172.21.15.186:3300/0 conn(0x7f54300c44b0 0x7f54301541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 -- 172.21.15.16:0/3546030840 >> v1:172.21.15.16:6789/0 conn(0x7f54300c6780 legacy=0x7f54300c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 -- 172.21.15.16:0/3546030840 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543006da20 con 0x7f543015d6b0 2024-04-25T10:39:04.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f542d400640 1 -- 172.21.15.16:0/3546030840 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000486318 0 0) 0x7f54300c5510 con 0x7f54300c6780 2024-04-25T10:39:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.564+0000 7f5427e00640 1 --2- 172.21.15.16:0/3546030840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f543015d6b0 0x7f543015dac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd8f0 tx=0x7f541801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76426313a7e5a155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542d400640 1 -- 172.21.15.16:0/3546030840 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180a7070 con 0x7f543015d6b0 2024-04-25T10:39:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542d400640 1 -- 172.21.15.16:0/3546030840 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54180b0070 con 0x7f543015d6b0 2024-04-25T10:39:04.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542d400640 1 -- 172.21.15.16:0/3546030840 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180ab890 con 0x7f543015d6b0 2024-04-25T10:39:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- 172.21.15.16:0/3546030840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f543015d6b0 msgr2=0x7f543015dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 --2- 172.21.15.16:0/3546030840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f543015d6b0 0x7f543015dac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd8f0 tx=0x7f541801c580 comp rx=0 tx=0).stop 2024-04-25T10:39:04.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- 172.21.15.16:0/3546030840 shutdown_connections 2024-04-25T10:39:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 --2- 172.21.15.16:0/3546030840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f543015d6b0 0x7f543015dac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 --2- 172.21.15.16:0/3546030840 >> v2:172.21.15.186:3300/0 conn(0x7f54300c44b0 0x7f54301541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- 172.21.15.16:0/3546030840 >> 172.21.15.16:0/3546030840 conn(0x7f5430073aa0 msgr2=0x7f5430073eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- 172.21.15.16:0/3546030840 shutdown_connections 2024-04-25T10:39:04.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- 172.21.15.16:0/3546030840 wait complete. 2024-04-25T10:39:04.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 Processor -- start 2024-04-25T10:39:04.573 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.568+0000 7f542f200640 1 -- start start 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54300c6780 0x7f5430157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f543015d6b0 0x7f54301562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f54300c72a0 con 0x7f54300c44b0 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f543015e000 con 0x7f54300c6780 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f54300c7420 con 0x7f543015d6b0 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48248/0 (socket says 172.21.15.16:48248) 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 -- 172.21.15.16:0/3035780137 learned_addr learned my addr 172.21.15.16:0/3035780137 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f5427e00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54300c6780 0x7f5430157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 -- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f543015d6b0 msgr2=0x7f54301562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f543015d6b0 0x7f54301562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 -- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54300c6780 msgr2=0x7f5430157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54300c6780 0x7f5430157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 -- 172.21.15.16:0/3035780137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5430155280 con 0x7f54300c44b0 2024-04-25T10:39:04.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542de00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f542000d840 tx=0x7f542000dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542000de30 con 0x7f54300c44b0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5420019070 con 0x7f54300c44b0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54301446a0 con 0x7f54300c44b0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542000bb10 con 0x7f54300c44b0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5430144c60 con 0x7f54300c44b0 2024-04-25T10:39:04.577 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.572+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5430076d30 con 0x7f54300c44b0 2024-04-25T10:39:04.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.576+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f542001e460 con 0x7f54300c44b0 2024-04-25T10:39:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.576+0000 7f5426000640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 0x7f5408071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.576+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f542008fc90 con 0x7f54300c44b0 2024-04-25T10:39:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.576+0000 7f5427e00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 0x7f5408071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.576+0000 7f5427e00640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 0x7f5408071ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54180af000 tx=0x7f54180a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.580+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f542005c760 con 0x7f54300c44b0 2024-04-25T10:39:04.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.780+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f543006e740 con 0x7f54300c44b0 2024-04-25T10:39:04.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.780+0000 7f5426000640 1 -- 172.21.15.16:0/3035780137 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6834 (secure 0 0 0) 0x7f542005c060 con 0x7f54300c44b0 2024-04-25T10:39:04.785 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:04.785 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:03.802112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-04-25T10:39:04.786 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-25T10:39:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 msgr2=0x7f5408071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 0x7f5408071ab0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54180af000 tx=0x7f54180a7000 comp rx=0 tx=0).stop 2024-04-25T10:39:04.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 msgr2=0x7f54301460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f542000d840 tx=0x7f542000dd00 comp rx=0 tx=0).stop 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 shutdown_connections 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f540806f5a0 0x7f5408071ab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f543015d6b0 0x7f54301562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54300c6780 0x7f5430157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 --2- 172.21.15.16:0/3035780137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54300c44b0 0x7f54301460a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 >> 172.21.15.16:0/3035780137 conn(0x7f5430073aa0 msgr2=0x7f54300c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 shutdown_connections 2024-04-25T10:39:04.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.784+0000 7f542f200640 1 -- 172.21.15.16:0/3035780137 wait complete. 2024-04-25T10:39:04.809 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:04.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.956+0000 7f3fb3a00640 1 Processor -- start 2024-04-25T10:39:04.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.956+0000 7f3fb3a00640 1 -- start start 2024-04-25T10:39:04.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3fac0b2e10 0x7f3fac0c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fac0b3220 0x7f3fac159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac15a340 0x7f3fac06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac15dd40 con 0x7f3fac0b3220 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3fac154560 con 0x7f3fac0b2e10 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb3a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3fac0b36e0 con 0x7f3fac15a340 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fac0b3220 0x7f3fac159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fac0b3220 0x7f3fac159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48264/0 (socket says 172.21.15.16:48264) 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1136362094 learned_addr learned my addr 172.21.15.16:0/1136362094 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb1a00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac15a340 0x7f3fac06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fb1000640 1 --2- 172.21.15.16:0/1136362094 >> v2:172.21.15.186:3300/0 conn(0x7f3fac0b2e10 0x7f3fac0c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1136362094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac15a340 msgr2=0x7f3fac06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac15a340 0x7f3fac06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1136362094 >> v2:172.21.15.186:3300/0 conn(0x7f3fac0b2e10 msgr2=0x7f3fac0c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:04.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1136362094 >> v2:172.21.15.186:3300/0 conn(0x7f3fac0b2e10 0x7f3fac0c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.960+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1136362094 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac0b39c0 con 0x7f3fac0b3220 2024-04-25T10:39:04.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac0b3220 0x7f3fac159e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0cefc0 tx=0x7f3f9401c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ba48d5c7215568 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fabe00640 1 -- 172.21.15.16:0/1136362094 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940ab600 con 0x7f3fac0b3220 2024-04-25T10:39:04.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fabe00640 1 -- 172.21.15.16:0/1136362094 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f940b0070 con 0x7f3fac0b3220 2024-04-25T10:39:04.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fabe00640 1 -- 172.21.15.16:0/1136362094 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940aba00 con 0x7f3fac0b3220 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1136362094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac0b3220 msgr2=0x7f3fac159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac0b3220 0x7f3fac159e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0cefc0 tx=0x7f3f9401c640 comp rx=0 tx=0).stop 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1136362094 shutdown_connections 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac15a340 0x7f3fac06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1136362094 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac0b3220 0x7f3fac159e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1136362094 >> v2:172.21.15.186:3300/0 conn(0x7f3fac0b2e10 0x7f3fac0c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1136362094 >> 172.21.15.16:0/1136362094 conn(0x7f3fac072a40 msgr2=0x7f3fac0ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1136362094 shutdown_connections 2024-04-25T10:39:04.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.964+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1136362094 wait complete. 2024-04-25T10:39:04.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 Processor -- start 2024-04-25T10:39:04.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- start start 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac0b2e10 0x7f3fac14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fac14e710 0x7f3fac1fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac0c3950 con 0x7f3fac15a340 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac15e1d0 con 0x7f3fac14e710 2024-04-25T10:39:04.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3fac0c9450 con 0x7f3fac0b2e10 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48274/0 (socket says 172.21.15.16:48274) 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1276278890 learned_addr learned my addr 172.21.15.16:0/1276278890 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb1000640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac0b2e10 0x7f3fac14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb1a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fac14e710 0x7f3fac1fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac0b2e10 msgr2=0x7f3fac14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac0b2e10 0x7f3fac14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fac14e710 msgr2=0x7f3fac1fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fac14e710 0x7f3fac1fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 -- 172.21.15.16:0/1276278890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac1fc600 con 0x7f3fac15a340 2024-04-25T10:39:04.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa3e00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f9401acf0 tx=0x7f3f9401ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940be610 con 0x7f3fac15a340 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f940be7b0 con 0x7f3fac15a340 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac157f50 con 0x7f3fac15a340 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940beba0 con 0x7f3fac15a340 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.968+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fac14f900 con 0x7f3fac15a340 2024-04-25T10:39:04.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fac0c55a0 con 0x7f3fac15a340 2024-04-25T10:39:04.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f940bc020 con 0x7f3fac15a340 2024-04-25T10:39:04.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fa9600640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 0x7f3f84071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:04.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3f941299b0 con 0x7f3fac15a340 2024-04-25T10:39:04.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fb1000640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 0x7f3f84071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:04.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.972+0000 7f3fb1000640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 0x7f3f84071ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c006fd0 tx=0x7f3f9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:04.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:04.976+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f94016230 con 0x7f3fac15a340 2024-04-25T10:39:05.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.144+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fac1594b0 con 0x7f3fac15a340 2024-04-25T10:39:05.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.144+0000 7f3fa9600640 1 -- 172.21.15.16:0/1276278890 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18515 (secure 0 0 0) 0x7f3f940f64e0 con 0x7f3fac15a340 2024-04-25T10:39:05.148 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:05.148 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":25,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:03.801775+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 msgr2=0x7f3f84071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 0x7f3f84071ab0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c006fd0 tx=0x7f3f9c008040 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 msgr2=0x7f3fac145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f9401acf0 tx=0x7f3f9401ae80 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 shutdown_connections 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3f8406f5a0 0x7f3f84071ab0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fac14e710 0x7f3fac1fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fac15a340 0x7f3fac145410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 --2- 172.21.15.16:0/1276278890 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fac0b2e10 0x7f3fac14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 >> 172.21.15.16:0/1276278890 conn(0x7f3fac072a40 msgr2=0x7f3fac0c3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 shutdown_connections 2024-04-25T10:39:05.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.148+0000 7f3fb3a00640 1 -- 172.21.15.16:0/1276278890 wait complete. 2024-04-25T10:39:05.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:05.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 Processor -- start 2024-04-25T10:39:05.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 -- start start 2024-04-25T10:39:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16640c80f0 0x7f16641551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16640c7910 con 0x7f166415eeb0 2024-04-25T10:39:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16640c6bc0 con 0x7f16640cbea0 2024-04-25T10:39:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1668c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f16640c6e80 con 0x7f16640c80f0 2024-04-25T10:39:05.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1661e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16640c80f0 0x7f16641551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1662800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f166415eeb0 0x7f16641658f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49306/0 (socket says 172.21.15.16:49306) 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1661e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f16640c80f0 0x7f16641551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48290/0 (socket says 172.21.15.16:48290) 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.320+0000 7f1662800640 1 -- 172.21.15.16:0/3114272822 learned_addr learned my addr 172.21.15.16:0/3114272822 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661e00640 1 -- 172.21.15.16:0/3114272822 >> v1:172.21.15.186:6789/0 conn(0x7f16640cbea0 legacy=0x7f166415e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661e00640 1 -- 172.21.15.16:0/3114272822 >> v1:172.21.15.16:6789/0 conn(0x7f166415eeb0 legacy=0x7f16641658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661e00640 1 -- 172.21.15.16:0/3114272822 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16640c7630 con 0x7f16640c80f0 2024-04-25T10:39:05.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661e00640 1 --2- 172.21.15.16:0/3114272822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640c80f0 0x7f16641551c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1654009900 tx=0x7f165401ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9840f0e93e4875b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661400640 1 -- 172.21.15.16:0/3114272822 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b5070 con 0x7f16640c80f0 2024-04-25T10:39:05.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661400640 1 -- 172.21.15.16:0/3114272822 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540a8a90 con 0x7f16640c80f0 2024-04-25T10:39:05.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.324+0000 7f1661400640 1 -- 172.21.15.16:0/3114272822 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16540b0440 con 0x7f16640c80f0 2024-04-25T10:39:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- 172.21.15.16:0/3114272822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640c80f0 msgr2=0x7f16641551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 --2- 172.21.15.16:0/3114272822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640c80f0 0x7f16641551c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1654009900 tx=0x7f165401ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- 172.21.15.16:0/3114272822 shutdown_connections 2024-04-25T10:39:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 --2- 172.21.15.16:0/3114272822 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640c80f0 0x7f16641551c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- 172.21.15.16:0/3114272822 >> 172.21.15.16:0/3114272822 conn(0x7f1664073160 msgr2=0x7f1664073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:05.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- 172.21.15.16:0/3114272822 shutdown_connections 2024-04-25T10:39:05.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- 172.21.15.16:0/3114272822 wait complete. 2024-04-25T10:39:05.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 Processor -- start 2024-04-25T10:39:05.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.328+0000 7f1668c00640 1 -- start start 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 0x7f1664145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166415eeb0 0x7f16641480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f16640cb9d0 con 0x7f16640cbea0 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1664155700 con 0x7f16640c80f0 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f16640cbb50 con 0x7f166415eeb0 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48298/0 (socket says 172.21.15.16:48298) 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 -- 172.21.15.16:0/1141459227 learned_addr learned my addr 172.21.15.16:0/1141459227 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1662800640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166415eeb0 0x7f16641480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1661e00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 0x7f1664145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 -- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166415eeb0 msgr2=0x7f16641480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166415eeb0 0x7f16641480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 -- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 msgr2=0x7f1664145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 0x7f1664145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 -- 172.21.15.16:0/1141459227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16640c95f0 con 0x7f16640cbea0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1661e00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 0x7f1664145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165be00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f164c00c4b0 tx=0x7f164c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c016020 con 0x7f16640cbea0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164c0052d0 con 0x7f16640cbea0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c007260 con 0x7f16640cbea0 2024-04-25T10:39:05.337 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166414de20 con 0x7f16640cbea0 2024-04-25T10:39:05.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16641fcd80 con 0x7f16640cbea0 2024-04-25T10:39:05.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.332+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1664050750 con 0x7f16640cbea0 2024-04-25T10:39:05.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.336+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f164c0074c0 con 0x7f16640cbea0 2024-04-25T10:39:05.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.336+0000 7f165a000640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 0x7f163c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.336+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f164c08efe0 con 0x7f16640cbea0 2024-04-25T10:39:05.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.336+0000 7f1661e00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 0x7f163c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.340 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.336+0000 7f1661e00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 0x7f163c071ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16540b2000 tx=0x7f1654008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.340+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f164c020020 con 0x7f16640cbea0 2024-04-25T10:39:05.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.508+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16641fd040 con 0x7f16640cbea0 2024-04-25T10:39:05.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.508+0000 7f165a000640 1 -- 172.21.15.16:0/1141459227 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f164c005480 con 0x7f16640cbea0 2024-04-25T10:39:05.512 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:05.512 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 msgr2=0x7f163c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 0x7f163c071ab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16540b2000 tx=0x7f1654008040 comp rx=0 tx=0).stop 2024-04-25T10:39:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 msgr2=0x7f166415c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f164c00c4b0 tx=0x7f164c00c970 comp rx=0 tx=0).stop 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 shutdown_connections 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f163c06f5a0 0x7f163c071ab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f166415eeb0 0x7f16641480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16640cbea0 0x7f166415c6f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 --2- 172.21.15.16:0/1141459227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16640c80f0 0x7f1664145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 >> 172.21.15.16:0/1141459227 conn(0x7f1664073160 msgr2=0x7f1664158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 shutdown_connections 2024-04-25T10:39:05.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.512+0000 7f1668c00640 1 -- 172.21.15.16:0/1141459227 wait complete. 2024-04-25T10:39:05.551 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 Processor -- start 2024-04-25T10:39:05.702 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 -- start start 2024-04-25T10:39:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd7c40c49b0 0x7fd7c4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd7c4162620 0x7fd7c4164a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.704 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c40705c0 con 0x7fd7c40ca730 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c40c41d0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c9a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c4070880 con 0x7fd7c4162620 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd7c40c49b0 0x7fd7c4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c2a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd7c40ca730 0x7fd7c40b20b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49310/0 (socket says 172.21.15.16:49310) 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd7c40c49b0 0x7fd7c4159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48312/0 (socket says 172.21.15.16:48312) 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c2a00640 1 -- 172.21.15.16:0/3491219674 learned_addr learned my addr 172.21.15.16:0/3491219674 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c3400640 1 --2- 172.21.15.16:0/3491219674 >> v2:172.21.15.186:3300/0 conn(0x7fd7c4162620 0x7fd7c4164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 -- 172.21.15.16:0/3491219674 >> v2:172.21.15.186:3300/0 conn(0x7fd7c4162620 msgr2=0x7fd7c4164a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 --2- 172.21.15.16:0/3491219674 >> v2:172.21.15.186:3300/0 conn(0x7fd7c4162620 0x7fd7c4164a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 -- 172.21.15.16:0/3491219674 >> v1:172.21.15.16:6789/0 conn(0x7fd7c40ca730 legacy=0x7fd7c40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7bbe00640 1 -- 172.21.15.16:0/3491219674 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c4070b60 con 0x7fd7c40c49b0 2024-04-25T10:39:05.705 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.700+0000 7fd7c2000640 1 -- 172.21.15.16:0/3491219674 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440971671 0 0) 0x7fd7c40705c0 con 0x7fd7c40ca730 2024-04-25T10:39:05.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7bbe00640 1 --2- 172.21.15.16:0/3491219674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4159cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40c40c0 tx=0x7fd7ac01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f3108811b8b360 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.707 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c2000640 1 -- 172.21.15.16:0/3491219674 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0a9660 con 0x7fd7c40c49b0 2024-04-25T10:39:05.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c2000640 1 -- 172.21.15.16:0/3491219674 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0a9800 con 0x7fd7c40c49b0 2024-04-25T10:39:05.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c2000640 1 -- 172.21.15.16:0/3491219674 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0a9bd0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 -- 172.21.15.16:0/3491219674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 msgr2=0x7fd7c4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.708 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/3491219674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4159cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40c40c0 tx=0x7fd7ac01c580 comp rx=0 tx=0).stop 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 -- 172.21.15.16:0/3491219674 shutdown_connections 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/3491219674 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4159cb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/3491219674 >> v2:172.21.15.186:3300/0 conn(0x7fd7c4162620 0x7fd7c4164a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 -- 172.21.15.16:0/3491219674 >> 172.21.15.16:0/3491219674 conn(0x7fd7c40ce950 msgr2=0x7fd7c40cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 -- 172.21.15.16:0/3491219674 shutdown_connections 2024-04-25T10:39:05.709 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.704+0000 7fd7c9a00640 1 -- 172.21.15.16:0/3491219674 wait complete. 2024-04-25T10:39:05.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 Processor -- start 2024-04-25T10:39:05.711 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 -- start start 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7c40ca730 0x7fd7c4154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c4162620 0x7fd7c41fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40b2940 con 0x7fd7c40c49b0 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c40b27c0 con 0x7fd7c4162620 2024-04-25T10:39:05.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c9a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c40c3c20 con 0x7fd7c40ca730 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48314/0 (socket says 172.21.15.16:48314) 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 -- 172.21.15.16:0/772219880 learned_addr learned my addr 172.21.15.16:0/772219880 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c3400640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c4162620 0x7fd7c41fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7bbe00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7c40ca730 0x7fd7c4154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 -- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7c40ca730 msgr2=0x7fd7c4154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7c40ca730 0x7fd7c4154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 -- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c4162620 msgr2=0x7fd7c41fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c4162620 0x7fd7c41fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 -- 172.21.15.16:0/772219880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c41547e0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.708+0000 7fd7c2a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c550 tx=0x7fd7b400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4018070 con 0x7fd7c40c49b0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b40074e0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4004a30 con 0x7fd7c40c49b0 2024-04-25T10:39:05.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c4148ec0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c4149160 con 0x7fd7c40c49b0 2024-04-25T10:39:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c4050750 con 0x7fd7c40c49b0 2024-04-25T10:39:05.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd7b401b070 con 0x7fd7c40c49b0 2024-04-25T10:39:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 0x7fd79c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd7b408e9e0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.712+0000 7fd7bbe00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 0x7fd79c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:05.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.716+0000 7fd7bbe00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 0x7fd79c071ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0ae000 tx=0x7fd7ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:05.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.720+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7c41547e0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c4164a00 con 0x7fd7c40c49b0 2024-04-25T10:39:05.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7baa00640 1 -- 172.21.15.16:0/772219880 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6834 (secure 0 0 0) 0x7fd7b405b5d0 con 0x7fd7c40c49b0 2024-04-25T10:39:05.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:05.923 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4268,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:03.802112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4306,"qdb_cluster":[4306]},"id":1}]} 2024-04-25T10:39:05.923 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 7 2024-04-25T10:39:05.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 msgr2=0x7fd79c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 0x7fd79c071ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0ae000 tx=0x7fd7ac009040 comp rx=0 tx=0).stop 2024-04-25T10:39:05.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 msgr2=0x7fd7c4153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c550 tx=0x7fd7b400ca10 comp rx=0 tx=0).stop 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 shutdown_connections 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd79c06f5a0 0x7fd79c071ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7c4162620 0x7fd7c41fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7c40ca730 0x7fd7c4154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 --2- 172.21.15.16:0/772219880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7c40c49b0 0x7fd7c4153ad0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 >> 172.21.15.16:0/772219880 conn(0x7fd7c40ce950 msgr2=0x7fd7c4159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 shutdown_connections 2024-04-25T10:39:05.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:05.920+0000 7fd7c9a00640 1 -- 172.21.15.16:0/772219880 wait complete. 2024-04-25T10:39:05.945 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:06.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.092+0000 7fcf7ee00640 1 Processor -- start 2024-04-25T10:39:06.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.092+0000 7fcf7ee00640 1 -- start start 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf7ee00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf78153fc0 0x7fcf780c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf7ee00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcf780c9190 0x7fcf780c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf7ee00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf780ca9e0 con 0x7fcf780c4c20 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf7ee00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcf780c7c40 con 0x7fcf78153fc0 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf7ee00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcf780c7e90 con 0x7fcf780c9190 2024-04-25T10:39:06.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf78153fc0 0x7fcf780c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf78153fc0 0x7fcf780c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48330/0 (socket says 172.21.15.16:48330) 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 -- 172.21.15.16:0/2496822549 learned_addr learned my addr 172.21.15.16:0/2496822549 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf6fe00640 1 --2- 172.21.15.16:0/2496822549 >> v2:172.21.15.186:3300/0 conn(0x7fcf780c9190 0x7fcf780c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 -- 172.21.15.16:0/2496822549 >> v2:172.21.15.186:3300/0 conn(0x7fcf780c9190 msgr2=0x7fcf780c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 --2- 172.21.15.16:0/2496822549 >> v2:172.21.15.186:3300/0 conn(0x7fcf780c9190 0x7fcf780c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 -- 172.21.15.16:0/2496822549 >> v1:172.21.15.186:6789/0 conn(0x7fcf780c4c20 legacy=0x7fcf7815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.096+0000 7fcf77e00640 1 -- 172.21.15.16:0/2496822549 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780c8170 con 0x7fcf78153fc0 2024-04-25T10:39:06.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf77e00640 1 --2- 172.21.15.16:0/2496822549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf78153fc0 0x7fcf780c8c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf780c7dc0 tx=0x7fcf6801c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bac9e27b51143e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:06.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf77400640 1 -- 172.21.15.16:0/2496822549 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf680ab640 con 0x7fcf78153fc0 2024-04-25T10:39:06.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf77400640 1 -- 172.21.15.16:0/2496822549 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf680b0070 con 0x7fcf78153fc0 2024-04-25T10:39:06.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf77400640 1 -- 172.21.15.16:0/2496822549 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf680aba40 con 0x7fcf78153fc0 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2496822549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf78153fc0 msgr2=0x7fcf780c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2496822549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf78153fc0 0x7fcf780c8c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf780c7dc0 tx=0x7fcf6801c640 comp rx=0 tx=0).stop 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2496822549 shutdown_connections 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2496822549 >> v2:172.21.15.186:3300/0 conn(0x7fcf780c9190 0x7fcf780c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2496822549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf78153fc0 0x7fcf780c8c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2496822549 >> 172.21.15.16:0/2496822549 conn(0x7fcf780cdc80 msgr2=0x7fcf780c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:06.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2496822549 shutdown_connections 2024-04-25T10:39:06.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2496822549 wait complete. 2024-04-25T10:39:06.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 Processor -- start 2024-04-25T10:39:06.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.100+0000 7fcf7ee00640 1 -- start start 2024-04-25T10:39:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf780c4c20 0x7fcf781fc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 0x7fcf781ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf781543d0 con 0x7fcf780c9190 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf780c5440 con 0x7fcf78153fc0 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcf78154550 con 0x7fcf780c4c20 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48338/0 (socket says 172.21.15.16:48338) 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 -- 172.21.15.16:0/2865072124 learned_addr learned my addr 172.21.15.16:0/2865072124 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf77e00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf780c4c20 0x7fcf781fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ce00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 0x7fcf781ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 -- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf780c4c20 msgr2=0x7fcf781fc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf780c4c20 0x7fcf781fc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 -- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 msgr2=0x7fcf781ee200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 0x7fcf781ee200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 -- 172.21.15.16:0/2865072124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf780c67c0 con 0x7fcf780c9190 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ce00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 0x7fcf781ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf6fe00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d870 tx=0x7fcf6000dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60007e50 con 0x7fcf780c9190 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60019070 con 0x7fcf780c9190 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6000baf0 con 0x7fcf780c9190 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf781fbcc0 con 0x7fcf780c9190 2024-04-25T10:39:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf781574a0 con 0x7fcf780c9190 2024-04-25T10:39:06.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.104+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf78050750 con 0x7fcf780c9190 2024-04-25T10:39:06.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.108+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcf6000bcd0 con 0x7fcf780c9190 2024-04-25T10:39:06.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.108+0000 7fcf74c00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 0x7fcf50071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:06.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.108+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcf6008fa10 con 0x7fcf780c9190 2024-04-25T10:39:06.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.108+0000 7fcf77e00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 0x7fcf50071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:06.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.108+0000 7fcf77e00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 0x7fcf50071c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf680af000 tx=0x7fcf680a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:06.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.112+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcf6005c600 con 0x7fcf780c9190 2024-04-25T10:39:06.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.276+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf78000960 con 0x7fcf780c9190 2024-04-25T10:39:06.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf74c00640 1 -- 172.21.15.16:0/2865072124 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fcf6005bf00 con 0x7fcf780c9190 2024-04-25T10:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:06.282 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 msgr2=0x7fcf50071c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 0x7fcf50071c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcf680af000 tx=0x7fcf680a7000 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 msgr2=0x7fcf7814d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000d870 tx=0x7fcf6000dd30 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 shutdown_connections 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf5006f770 0x7fcf50071c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf78153fc0 0x7fcf781ee200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf780c9190 0x7fcf7814d5a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 --2- 172.21.15.16:0/2865072124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf780c4c20 0x7fcf781fc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 >> 172.21.15.16:0/2865072124 conn(0x7fcf780cdc80 msgr2=0x7fcf78158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 shutdown_connections 2024-04-25T10:39:06.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:06.280+0000 7fcf7ee00640 1 -- 172.21.15.16:0/2865072124 wait complete. 2024-04-25T10:39:06.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:38:58.741400+0000', 'modified': '2024-04-25T10:39:03.802112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6839/3608237615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 3608237615}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 3608237615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4306, 'qdb_cluster': [4306]} 2024-04-25T10:39:06.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:39:06.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T10:39:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 Processor -- start 2024-04-25T10:39:07.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 -- start start 2024-04-25T10:39:07.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddb01648d0 0x7fddb0166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb00b8f60 con 0x7fddb00c7c40 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddb00b9220 con 0x7fddb015b9d0 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddb4c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fddb00b9ac0 con 0x7fddb01648d0 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddade00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fddb00c7c40 0x7fddb00c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49312/0 (socket says 172.21.15.16:49312) 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddade00640 1 -- 172.21.15.16:0/2278864180 learned_addr learned my addr 172.21.15.16:0/2278864180 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddae800640 1 --2- 172.21.15.16:0/2278864180 >> v2:172.21.15.16:3300/0 conn(0x7fddb01648d0 0x7fddb0166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddae800640 1 -- 172.21.15.16:0/2278864180 >> v1:172.21.15.186:6789/0 conn(0x7fddb015b9d0 legacy=0x7fddb00c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddae800640 1 -- 172.21.15.16:0/2278864180 >> v1:172.21.15.16:6789/0 conn(0x7fddb00c7c40 legacy=0x7fddb00c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.068+0000 7fddae800640 1 -- 172.21.15.16:0/2278864180 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb00b9500 con 0x7fddb01648d0 2024-04-25T10:39:07.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddae800640 1 --2- 172.21.15.16:0/2278864180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb01648d0 0x7fddb0166cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009ee0 tx=0x7fdda801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c715546b7660c646 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddad400640 1 -- 172.21.15.16:0/2278864180 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b2070 con 0x7fddb01648d0 2024-04-25T10:39:07.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddad400640 1 -- 172.21.15.16:0/2278864180 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda80a5980 con 0x7fddb01648d0 2024-04-25T10:39:07.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddad400640 1 -- 172.21.15.16:0/2278864180 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80a5d90 con 0x7fddb01648d0 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 -- 172.21.15.16:0/2278864180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb01648d0 msgr2=0x7fddb0166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 --2- 172.21.15.16:0/2278864180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb01648d0 0x7fddb0166cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009ee0 tx=0x7fdda801c9e0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 -- 172.21.15.16:0/2278864180 shutdown_connections 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 --2- 172.21.15.16:0/2278864180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb01648d0 0x7fddb0166cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 -- 172.21.15.16:0/2278864180 >> 172.21.15.16:0/2278864180 conn(0x7fddb00cdc80 msgr2=0x7fddb00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 -- 172.21.15.16:0/2278864180 shutdown_connections 2024-04-25T10:39:07.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.072+0000 7fddb4c00640 1 -- 172.21.15.16:0/2278864180 wait complete. 2024-04-25T10:39:07.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 Processor -- start 2024-04-25T10:39:07.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 -- start start 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddb015b9d0 0x7fddb0140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddb01648d0 0x7fddb013f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00c82d0 con 0x7fddb00c7c40 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fddb00c8150 con 0x7fddb01648d0 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddb4c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fddb00c7000 con 0x7fddb015b9d0 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddade00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddade00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48358/0 (socket says 172.21.15.16:48358) 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.076+0000 7fddade00640 1 -- 172.21.15.16:0/3652449276 learned_addr learned my addr 172.21.15.16:0/3652449276 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddae800640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddb01648d0 0x7fddb013f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fdda7e00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddb015b9d0 0x7fddb0140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 -- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddb015b9d0 msgr2=0x7fddb0140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddb015b9d0 0x7fddb0140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 -- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddb01648d0 msgr2=0x7fddb013f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddb01648d0 0x7fddb013f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 -- 172.21.15.16:0/3652449276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb013ea70 con 0x7fddb00c7c40 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddade00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c520 tx=0x7fdda000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fdda6000640 1 -- 172.21.15.16:0/3652449276 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0017070 con 0x7fddb00c7c40 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fdda6000640 1 -- 172.21.15.16:0/3652449276 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda0005d30 con 0x7fddb00c7c40 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fdda6000640 1 -- 172.21.15.16:0/3652449276 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0007270 con 0x7fddb00c7c40 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb0141390 con 0x7fddb00c7c40 2024-04-25T10:39:07.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb0154bd0 con 0x7fddb00c7c40 2024-04-25T10:39:07.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.080+0000 7fdda6000640 1 -- 172.21.15.16:0/3652449276 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdda001a070 con 0x7fddb00c7c40 2024-04-25T10:39:07.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda6000640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 0x7fdd88071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda6000640 1 -- 172.21.15.16:0/3652449276 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdda008e820 con 0x7fddb00c7c40 2024-04-25T10:39:07.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 Processor -- start 2024-04-25T10:39:07.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 0x7fdd88071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 -- start start 2024-04-25T10:39:07.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 0x7fdd88071ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddb0158b20 tx=0x7fdd98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94530c20 0x55ba946815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ba944fe160 con 0x55ba9451cea0 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ba94493e20 con 0x55ba94115280 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55ba9444ca20 con 0x55ba94530c20 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48362/0 (socket says 172.21.15.16:48362) 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 -- 172.21.15.16:0/2570871095 learned_addr learned my addr 172.21.15.16:0/2570871095 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddae800640 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fddade00640 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94530c20 0x55ba946815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 -- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94530c20 msgr2=0x55ba946815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94530c20 0x55ba946815d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 -- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 msgr2=0x55ba9464ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 -- 172.21.15.16:0/2570871095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba94451100 con 0x55ba9451cea0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd98004580 tx=0x7fdd98011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c7d755b0f55421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.084+0000 7fdd9e600640 1 -- 172.21.15.16:0/2570871095 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98025070 con 0x55ba9451cea0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fdd9e600640 1 -- 172.21.15.16:0/2570871095 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd98015800 con 0x55ba9451cea0 2024-04-25T10:39:07.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fdd9e600640 1 -- 172.21.15.16:0/2570871095 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98015bb0 con 0x55ba9451cea0 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2570871095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 msgr2=0x55ba9464c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd98004580 tx=0x7fdd98011000 comp rx=0 tx=0).stop 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2570871095 shutdown_connections 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba9464c550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2570871095 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94530c20 0x55ba946815d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2570871095 >> 172.21.15.16:0/2570871095 conn(0x55ba94154ff0 msgr2=0x55ba94684030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2570871095 shutdown_connections 2024-04-25T10:39:07.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2570871095 wait complete. 2024-04-25T10:39:07.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- start start 2024-04-25T10:39:07.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 Processor -- start 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946941b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ba944a1220 con 0x55ba94530c20 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ba94437ea0 con 0x55ba94115280 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.088+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55ba9448eb00 con 0x55ba9451cea0 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 10 client.0 _ll_register_callbacks cb 0x55ba944a0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48368/0 (socket says 172.21.15.16:48368) 2024-04-25T10:39:07.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 -- 172.21.15.16:0/1038737686 learned_addr learned my addr 172.21.15.16:0/1038737686 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddade00640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdda7e00640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 -- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 msgr2=0x55ba946941b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946941b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 -- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 msgr2=0x55ba9464a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 -- 172.21.15.16:0/1038737686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba94433500 con 0x55ba94530c20 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddae800640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009ee0 tx=0x7fdda801b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2868c370ca4bbcc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:07.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b2040 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdda80b8450 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd98015800 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fdda80c7050 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 10 client.4386 fetch_fsmap learned FSMap version 7 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ba94419ea0 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd98015800 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7fdda80ca020 con 0x55ba94530c20 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 10 client.4386 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 10 client.4386 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 20 client.4386 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba941397d0 0x55ba946809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 4 client.4386 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:39:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 --> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9442cbe0 con 0x55ba941397d0 2024-04-25T10:39:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddade00640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba941397d0 0x55ba946809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fddade00640 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba941397d0 0x55ba946809d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2a4c7a49603d3c server_cookie=9f21dd84d4278638 in_seq=0 out_seq=0 2024-04-25T10:39:07.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.092+0000 7fdd92a00640 10 client.4386 ms_handle_connect on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:07.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fdd92a00640 1 -- 172.21.15.16:0/1038737686 <== mds.0 v2:172.21.15.186:6838/3608237615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba9442cbe0 con 0x55ba941397d0 2024-04-25T10:39:07.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fdd92a00640 10 client.4386 handle_command_reply: tid=0 2024-04-25T10:39:07.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 client.4386 shutdown 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 msgr2=0x55ba946946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009ee0 tx=0x7fdda801b220 comp rx=0 tx=0).stop 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 shutdown_connections 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba941397d0 0x55ba946809d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946946f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946941b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/1038737686 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba9464a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 >> 172.21.15.16:0/1038737686 conn(0x55ba94154ff0 msgr2=0x55ba946817e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fdd92a00640 0 client.4386 ms_handle_reset on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 shutdown_connections 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 1 -- 172.21.15.16:0/1038737686 wait complete. 2024-04-25T10:39:07.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.096+0000 7fddbc2d1000 20 client.4386 trim_cache size 0 max 16384 2024-04-25T10:39:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 Processor -- start 2024-04-25T10:39:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 -- start start 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba94693d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5800cc20 con 0x55ba94530c20 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ba944297d0 con 0x55ba94115280 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55ba94493130 con 0x55ba9451cea0 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48378/0 (socket says 172.21.15.16:48378) 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 -- 172.21.15.16:0/3424151320 learned_addr learned my addr 172.21.15.16:0/3424151320 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddade00640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba94693d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fdda7e00640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 -- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 msgr2=0x55ba946f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 -- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 msgr2=0x55ba94693d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba94693d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 -- 172.21.15.16:0/3424151320 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba9444cc70 con 0x55ba94530c20 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddade00640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba94693d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fddae800640 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdda8004a90 tx=0x7fdda80b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc96c6522b25ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fdd9dc00640 1 -- 172.21.15.16:0/3424151320 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b2050 con 0x55ba94530c20 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fdd9dc00640 1 -- 172.21.15.16:0/3424151320 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda80a5d40 con 0x55ba94530c20 2024-04-25T10:39:07.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.116+0000 7fdd9dc00640 1 -- 172.21.15.16:0/3424151320 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b8c90 con 0x55ba94530c20 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- 172.21.15.16:0/3424151320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 msgr2=0x55ba946f3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdda8004a90 tx=0x7fdda80b8000 comp rx=0 tx=0).stop 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- 172.21.15.16:0/3424151320 shutdown_connections 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba94530c20 0x55ba946f3290 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba9451cea0 0x55ba946f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/3424151320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94115280 0x55ba94693d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- 172.21.15.16:0/3424151320 >> 172.21.15.16:0/3424151320 conn(0x55ba94154ff0 msgr2=0x55ba9469f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- 172.21.15.16:0/3424151320 shutdown_connections 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- 172.21.15.16:0/3424151320 wait complete. 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- start start 2024-04-25T10:39:07.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 Processor -- start 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 0x55ba946f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94530c20 0x55ba946ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55ba944a00c0 con 0x55ba9451cea0 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55ba94498450 con 0x55ba94530c20 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55ba94649c40 con 0x55ba94115280 2024-04-25T10:39:07.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddbc2d1000 10 client.0 _ll_register_callbacks cb 0x7fdda80b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48394/0 (socket says 172.21.15.16:48394) 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 -- 172.21.15.16:0/2418780318 learned_addr learned my addr 172.21.15.16:0/2418780318 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddade00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 0x55ba946f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddae800640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94530c20 0x55ba946ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 -- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 msgr2=0x55ba946f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 0x55ba946f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 -- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94530c20 msgr2=0x55ba946ef6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94530c20 0x55ba946ef6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fdda7e00640 1 -- 172.21.15.16:0/2418780318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba94516180 con 0x55ba9451cea0 2024-04-25T10:39:07.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.120+0000 7fddade00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 0x55ba946f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdda7e00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55ba942adc70 tx=0x7fdd980036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1abc3af80ce926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9802f070 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdda80a5d40 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdd98015c10 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fdd9803a050 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 10 client.4392 fetch_fsmap learned FSMap version 7 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55ba9414d0c0 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda80a5d40 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7fdd9803d020 con 0x55ba9451cea0 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T10:39:07.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 10 client.4392 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 20 client.4392 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba94127830 0x55ba9470b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 4 client.4392 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 --> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] -- command(tid 0: {"prefix": "status"}) -- 0x55ba944a1a30 con 0x55ba94127830 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddade00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba94127830 0x55ba9470b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 10 client.4392 ms_handle_connect on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:07.131 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddade00640 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba94127830 0x55ba9470b200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c0a936ae4a8fbf server_cookie=295dbe286d685ef0 in_seq=0 out_seq=0 2024-04-25T10:39:07.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 1 -- 172.21.15.16:0/2418780318 <== mds.0 v2:172.21.15.186:6838/3608237615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55ba944a1a30 con 0x55ba94127830 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 10 client.4392 handle_command_reply: tid=0 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 client.4392 shutdown 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 msgr2=0x55ba946f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55ba942adc70 tx=0x7fdd980036b0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 shutdown_connections 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55ba94127830 0x55ba9470b200 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ba94530c20 0x55ba946ef6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55ba9451cea0 0x55ba946f93b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 --2- 172.21.15.16:0/2418780318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55ba94115280 0x55ba946f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fdd92a00640 0 client.4392 ms_handle_reset on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 >> 172.21.15.16:0/2418780318 conn(0x55ba94154ff0 msgr2=0x55ba9467f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 shutdown_connections 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 1 -- 172.21.15.16:0/2418780318 wait complete. 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.124+0000 7fddbc2d1000 20 client.4392 trim_cache size 0 max 16384 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "0bf3f6ca-8da3-483e-865e-01c1c2057abb", 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4306, 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 7.7974038319999996, 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 7, 2024-04-25T10:39:07.134 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 26, 2024-04-25T10:39:07.135 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T10:39:07.135 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 15.695325667000001 2024-04-25T10:39:07.135 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T10:39:07.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 msgr2=0x7fdd88071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 0x7fdd88071ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddb0158b20 tx=0x7fdd98009040 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 msgr2=0x7fddb0139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdda000c520 tx=0x7fdda000c9e0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 shutdown_connections 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fdd8806f5d0 0x7fdd88071ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddb01648d0 0x7fddb013f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddb015b9d0 0x7fddb0140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 --2- 172.21.15.16:0/3652449276 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddb00c7c40 0x7fddb0139080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 >> 172.21.15.16:0/3652449276 conn(0x7fddb00cdc80 msgr2=0x7fddb0166140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 shutdown_connections 2024-04-25T10:39:07.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.128+0000 7fddb4c00640 1 -- 172.21.15.16:0/3652449276 wait complete. 2024-04-25T10:39:07.150 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:39:07.151 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:07.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:39:07.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 Processor -- start 2024-04-25T10:39:07.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 -- start start 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2d480c6850 0x7f2d480c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d48154340 0x7f2d4806d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d4815e330 con 0x7f2d4806dcc0 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4815d440 con 0x7f2d48154340 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4f400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f2d4815d720 con 0x7f2d480c6850 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d47e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d48154340 0x7f2d4806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d47e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d48154340 0x7f2d4806d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48400/0 (socket says 172.21.15.16:48400) 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d47e00640 1 -- 172.21.15.16:0/3668621661 learned_addr learned my addr 172.21.15.16:0/3668621661 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4d400640 1 --1- 172.21.15.16:0/3668621661 >> v1:172.21.15.16:6789/0 conn(0x7f2d4806dcc0 0x7f2d4815a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49320/0 (socket says 172.21.15.16:49320) 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.300+0000 7f2d4ca00640 1 --2- 172.21.15.16:0/3668621661 >> v2:172.21.15.186:3300/0 conn(0x7f2d480c6850 0x7f2d480c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47e00640 1 -- 172.21.15.16:0/3668621661 >> v2:172.21.15.186:3300/0 conn(0x7f2d480c6850 msgr2=0x7f2d480c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:07.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47e00640 1 --2- 172.21.15.16:0/3668621661 >> v2:172.21.15.186:3300/0 conn(0x7f2d480c6850 0x7f2d480c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47e00640 1 -- 172.21.15.16:0/3668621661 >> v1:172.21.15.16:6789/0 conn(0x7f2d4806dcc0 legacy=0x7f2d4815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47e00640 1 -- 172.21.15.16:0/3668621661 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4815da00 con 0x7f2d48154340 2024-04-25T10:39:07.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47e00640 1 --2- 172.21.15.16:0/3668621661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d48154340 0x7f2d4806d780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d480cbdc0 tx=0x7f2d3401ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e609e7601046bfd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47400640 1 -- 172.21.15.16:0/3668621661 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b5070 con 0x7f2d48154340 2024-04-25T10:39:07.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47400640 1 -- 172.21.15.16:0/3668621661 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d340a8b30 con 0x7f2d48154340 2024-04-25T10:39:07.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d47400640 1 -- 172.21.15.16:0/3668621661 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b0440 con 0x7f2d48154340 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d4f400640 1 -- 172.21.15.16:0/3668621661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d48154340 msgr2=0x7f2d4806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.304+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3668621661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d48154340 0x7f2d4806d780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d480cbdc0 tx=0x7f2d3401ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 -- 172.21.15.16:0/3668621661 shutdown_connections 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3668621661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d48154340 0x7f2d4806d780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3668621661 >> v2:172.21.15.186:3300/0 conn(0x7f2d480c6850 0x7f2d480c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 -- 172.21.15.16:0/3668621661 >> 172.21.15.16:0/3668621661 conn(0x7f2d48072880 msgr2=0x7f2d480ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 -- 172.21.15.16:0/3668621661 shutdown_connections 2024-04-25T10:39:07.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 -- 172.21.15.16:0/3668621661 wait complete. 2024-04-25T10:39:07.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 Processor -- start 2024-04-25T10:39:07.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 -- start start 2024-04-25T10:39:07.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4806dcc0 0x7f2d4814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.308+0000 7f2d4f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d48154340 0x7f2d4814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4815a930 con 0x7f2d480c6850 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4815dfc0 con 0x7f2d4806dcc0 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4815aab0 con 0x7f2d48154340 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48408/0 (socket says 172.21.15.16:48408) 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 -- 172.21.15.16:0/3676584202 learned_addr learned my addr 172.21.15.16:0/3676584202 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4ca00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4806dcc0 0x7f2d4814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4d400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d48154340 0x7f2d4814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 -- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d48154340 msgr2=0x7f2d4814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d48154340 0x7f2d4814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 -- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4806dcc0 msgr2=0x7f2d4814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4806dcc0 0x7f2d4814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 -- 172.21.15.16:0/3676584202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4814c1e0 con 0x7f2d480c6850 2024-04-25T10:39:07.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d47e00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d340b3040 tx=0x7f2d3401bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b5040 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d340be070 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d480c3f80 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d340b9420 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d480c2c80 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d481f7490 con 0x7f2d480c6850 2024-04-25T10:39:07.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.312+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d340b95c0 con 0x7f2d480c6850 2024-04-25T10:39:07.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.316+0000 7f2d44c00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 0x7f2d24071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:07.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.316+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2d3412ca60 con 0x7f2d480c6850 2024-04-25T10:39:07.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.316+0000 7f2d4ca00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 0x7f2d24071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:07.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.316+0000 7f2d4ca00640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 0x7f2d24071ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:07.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.320+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d340c7020 con 0x7f2d480c6850 2024-04-25T10:39:07.532 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.528+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2d4806f0a0 con 0x7f2d480c6850 2024-04-25T10:39:07.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.528+0000 7f2d44c00640 1 -- 172.21.15.16:0/3676584202 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f2d34018990 con 0x7f2d480c6850 2024-04-25T10:39:07.533 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 msgr2=0x7f2d24071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 0x7f2d24071ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c008040 comp rx=0 tx=0).stop 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 msgr2=0x7f2d480c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d340b3040 tx=0x7f2d3401bbd0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 shutdown_connections 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f2d2406f5a0 0x7f2d24071ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d48154340 0x7f2d4814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d480c6850 0x7f2d480c3a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 --2- 172.21.15.16:0/3676584202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4806dcc0 0x7f2d4814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:07.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 >> 172.21.15.16:0/3676584202 conn(0x7f2d48072880 msgr2=0x7f2d48156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:07.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 shutdown_connections 2024-04-25T10:39:07.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07.532+0000 7f2d4f400640 1 -- 172.21.15.16:0/3676584202 wait complete. 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:39:07.555 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:39:07.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:07.556 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:39:07.565 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42459sec preferred_lft 42459sec 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:ab:6e:97:bf brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:39:07.566 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:07.568 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-25T10:39:07.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:39:07.569 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:07.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:07.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:07.729 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:39:07.787 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-25T10:39:07.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:07.790 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:39:08.140 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:39:08.140 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:08.141 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:08.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:39:08.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:39:08.141 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:39:08.141 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:08.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:08.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:08.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:08.243 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-25T10:39:08.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:08.253 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-25T10:39:08.302 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:08.302 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:08.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:08.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T10:39:08.302 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:08.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:08.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:08.438 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T10:39:08.439 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:08.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:08.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:08.602 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:08.602 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:08.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-25T10:39:08.602 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:39:08.602 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:08.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:08.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:08.688 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T10:39:08.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:39:08.688 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:08.697 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:39:08.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:39:08.698 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:08.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-25T10:39:08.813 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:39:08.866 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-25T10:39:08.867 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:08.868 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:08.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:08.869 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-25T10:39:08.926 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T10:39:08.926 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T10:39:08.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-25T10:39:08.999 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:39:09.051 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-25T10:39:09.051 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-25T10:39:09.051 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-25T10:39:09.051 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-25T10:39:09.052 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-25T10:39:09.053 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:39:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:39:09.055 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-25T10:39:09.055 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:09.055 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:09.056 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-25T10:39:09.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:2024-04-25T10:39:09.080+0000 7f711e515580 -1 init, newargv = 0x55a8436258b0 newargc=15 2024-04-25T10:39:09.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[32051]: starting ceph client 2024-04-25T10:39:09.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[32051]: starting fuse 2024-04-25T10:39:10.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo modprobe fuse 2024-04-25T10:39:10.222 DEBUG:teuthology.orchestra.run.smithi016:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/sys 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/proc 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/dev 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/pts 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/run 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/ 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/security 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/shm 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/run/lock 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/cgroup 2024-04-25T10:39:10.280 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/pstore 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/bpf 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/hugepages 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/dev/mqueue 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/debug 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/tracing 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/proc/fs/nfsd 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/fs/fuse/connections 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/sys/kernel/config 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/run/rpc_pipefs 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/run/user/1000 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:39:10.281 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:10.282 INFO:teuthology.orchestra.run.smithi016.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:10.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:10.283 DEBUG:teuthology.orchestra.run.smithi016:> ls /sys/fs/fuse/connections 2024-04-25T10:39:10.339 INFO:teuthology.orchestra.run.smithi016.stdout:44 2024-04-25T10:39:10.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo stdin-killer -- python3 -c ' 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> import glob 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> import re 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> import os 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> import subprocess 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> def _find_admin_socket(client_name): 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> files = glob.glob(asok_path) 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> # Given a non-glob path, it better be there 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> if "*" not in asok_path: 2024-04-25T10:39:10.340 DEBUG:teuthology.orchestra.run.smithi016:> assert(len(files) == 1) 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> return files[0] 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> for f in files: 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> contents = proc_f.read() 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> if mountpoint in contents: 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> return f 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> print(_find_admin_socket("client.admin")) 2024-04-25T10:39:10.341 DEBUG:teuthology.orchestra.run.smithi016:> ' 2024-04-25T10:39:10.478 INFO:teuthology.orchestra.run.smithi016.stdout:/var/run/ceph/ceph-client.admin.32051.asok 2024-04-25T10:39:10.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:10.490 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32051.asok 2024-04-25T10:39:10.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:10.490 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32051.asok status 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "metadata": { 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_sha1": "994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "ceph_version": "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)", 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "entity_id": "admin", 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "hostname": "smithi016", 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T10:39:10.680 INFO:teuthology.orchestra.run.smithi016.stdout: "pid": "32051", 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "root": "/" 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_count": 0, 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "dentry_pinned_count": 0, 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4407, 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "inst": { 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "name": { 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "client", 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "num": 4407 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 2546528969 2024-04-25T10:39:10.681 INFO:teuthology.orchestra.run.smithi016.stdout: } 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": { 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "type": "v1", 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "addr": "192.168.0.1:0", 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "nonce": 2546528969 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "inst_str": "client.4407 192.168.0.1:0/2546528969", 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "addr_str": "192.168.0.1:0/2546528969", 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "inode_count": 1, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "mds_epoch": 7, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch": 26, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "osd_epoch_barrier": 0, 2024-04-25T10:39:10.682 INFO:teuthology.orchestra.run.smithi016.stdout: "blocklisted": false, 2024-04-25T10:39:10.683 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs" 2024-04-25T10:39:10.683 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T10:39:10.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:10.696 DEBUG:teuthology.orchestra.run.smithi016:> stat --file-system '--printf=%T 2024-04-25T10:39:10.696 DEBUG:teuthology.orchestra.run.smithi016:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:10.706 INFO:teuthology.orchestra.run.smithi016.stdout:fuseblk 2024-04-25T10:39:10.706 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:10.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:10.706 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:10.774 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T10:39:10.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:39:10.909 INFO:teuthology.orchestra.run.smithi016.stdout:# file: . 2024-04-25T10:39:10.909 INFO:teuthology.orchestra.run.smithi016.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T10:39:10.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:10.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:10.916 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:39:10.916 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:39:10.929 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:11.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.120+0000 7ff156400640 1 Processor -- start 2024-04-25T10:39:11.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.120+0000 7ff156400640 1 -- start start 2024-04-25T10:39:11.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff156400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b3220 0x7ff150159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff156400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff15015a340 0x7ff15006d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.126 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff156400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff150154560 con 0x7ff1500b2e10 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff156400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff15015dd40 con 0x7ff15015a340 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff156400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff1500b36e0 con 0x7ff1500b3220 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff1500b2e10 0x7ff1500c3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49328/0 (socket says 172.21.15.16:49328) 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14f400640 1 -- 172.21.15.16:0/2741104904 learned_addr learned my addr 172.21.15.16:0/2741104904 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 --2- 172.21.15.16:0/2741104904 >> v2:172.21.15.16:3300/0 conn(0x7ff15015a340 0x7ff15006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.130 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff147e00640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b3220 0x7ff150159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14ea00640 1 -- 172.21.15.16:0/2741104904 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104763547 0 0) 0x7ff150154560 con 0x7ff1500b2e10 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14ea00640 1 -- 172.21.15.16:0/2741104904 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1340035c0 con 0x7ff1500b2e10 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 -- 172.21.15.16:0/2741104904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b3220 msgr2=0x7ff150159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b3220 0x7ff150159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 -- 172.21.15.16:0/2741104904 >> v1:172.21.15.16:6789/0 conn(0x7ff1500b2e10 legacy=0x7ff1500c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 -- 172.21.15.16:0/2741104904 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1500b39c0 con 0x7ff15015a340 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.124+0000 7ff14fe00640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff15006d780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ee0 tx=0x7ff14801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eaed5a8d5e1ac2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff14ea00640 1 -- 172.21.15.16:0/2741104904 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480b2070 con 0x7ff15015a340 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff14ea00640 1 -- 172.21.15.16:0/2741104904 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1480a5a50 con 0x7ff15015a340 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff14ea00640 1 -- 172.21.15.16:0/2741104904 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480a5e40 con 0x7ff15015a340 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- 172.21.15.16:0/2741104904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 msgr2=0x7ff15006d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff15006d780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff148009ee0 tx=0x7ff14801ca70 comp rx=0 tx=0).stop 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- 172.21.15.16:0/2741104904 shutdown_connections 2024-04-25T10:39:11.132 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff15006d780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 --2- 172.21.15.16:0/2741104904 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b3220 0x7ff150159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- 172.21.15.16:0/2741104904 >> 172.21.15.16:0/2741104904 conn(0x7ff150072a40 msgr2=0x7ff1500ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- 172.21.15.16:0/2741104904 shutdown_connections 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- 172.21.15.16:0/2741104904 wait complete. 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 Processor -- start 2024-04-25T10:39:11.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.128+0000 7ff156400640 1 -- start start 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 0x7ff1500c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1500c5620 0x7ff15015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff150166ec0 con 0x7ff15015a340 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff15015e1d0 con 0x7ff1500c5620 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff150167040 con 0x7ff1500b2e10 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48422/0 (socket says 172.21.15.16:48422) 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 -- 172.21.15.16:0/3390514007 learned_addr learned my addr 172.21.15.16:0/3390514007 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:11.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff14f400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 0x7ff1500c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff14fe00640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1500c5620 0x7ff15015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 -- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 msgr2=0x7ff1500c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 0x7ff1500c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 -- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1500c5620 msgr2=0x7ff15015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1500c5620 0x7ff15015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 -- 172.21.15.16:0/3390514007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501fc220 con 0x7ff15015a340 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff14f400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 0x7ff1500c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147e00640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d810 tx=0x7ff13800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13800de00 con 0x7ff15015a340 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff138019070 con 0x7ff15015a340 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1500c6810 con 0x7ff15015a340 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13800bb10 con 0x7ff15015a340 2024-04-25T10:39:11.137 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501fc430 con 0x7ff15015a340 2024-04-25T10:39:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.132+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1500b1830 con 0x7ff15015a340 2024-04-25T10:39:11.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.136+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff13800bcb0 con 0x7ff15015a340 2024-04-25T10:39:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.136+0000 7ff147400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 0x7ff128071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.136+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff13808f9d0 con 0x7ff15015a340 2024-04-25T10:39:11.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.136+0000 7ff14f400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 0x7ff128071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.136+0000 7ff14f400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 0x7ff128071ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff140001240 tx=0x7ff140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.144 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.140+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1500b1830 con 0x7ff15015a340 2024-04-25T10:39:11.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.304+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff150157d80 con 0x7ff15015a340 2024-04-25T10:39:11.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff147400640 1 -- 172.21.15.16:0/3390514007 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7ff13805c620 con 0x7ff15015a340 2024-04-25T10:39:11.311 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:11.311 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 msgr2=0x7ff128071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 0x7ff128071ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff140001240 tx=0x7ff140009040 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 msgr2=0x7ff1501fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d810 tx=0x7ff13800dcd0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 shutdown_connections 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff12806f5d0 0x7ff128071ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1500c5620 0x7ff15015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff15015a340 0x7ff1501fbce0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 --2- 172.21.15.16:0/3390514007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff1500b2e10 0x7ff1500c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 >> 172.21.15.16:0/3390514007 conn(0x7ff150072a40 msgr2=0x7ff150159410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:11.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 shutdown_connections 2024-04-25T10:39:11.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.308+0000 7ff156400640 1 -- 172.21.15.16:0/3390514007 wait complete. 2024-04-25T10:39:11.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:38:56.312069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:38:57.697392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:39:01.362964+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:39:11.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:39:11.495 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 Processor -- start 2024-04-25T10:39:11.496 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 -- start start 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30a815df50 0x7f30a8159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f30a80c30c0 0x7f30a80c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 0x7f30a80cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f30a815e360 con 0x7f30a815df50 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f30a815dac0 con 0x7f30a80c30c0 2024-04-25T10:39:11.498 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.492+0000 7f30ada00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f30a815d4b0 con 0x7f30a80c4af0 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30a815df50 0x7f30a8159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30a815df50 0x7f30a8159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48426/0 (socket says 172.21.15.16:48426) 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 -- 172.21.15.16:0/2286772685 learned_addr learned my addr 172.21.15.16:0/2286772685 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f309e000640 1 --2- 172.21.15.16:0/2286772685 >> v2:172.21.15.186:3300/0 conn(0x7f30a80c30c0 0x7f30a80c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a7400640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 0x7f30a80cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 -- 172.21.15.16:0/2286772685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 msgr2=0x7f30a80cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 0x7f30a80cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 -- 172.21.15.16:0/2286772685 >> v2:172.21.15.186:3300/0 conn(0x7f30a80c30c0 msgr2=0x7f30a80c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 --2- 172.21.15.16:0/2286772685 >> v2:172.21.15.186:3300/0 conn(0x7f30a80c30c0 0x7f30a80c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 -- 172.21.15.16:0/2286772685 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a80c57c0 con 0x7f30a815df50 2024-04-25T10:39:11.499 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a7400640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 0x7f30a80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:11.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6a00640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a8159ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30a80c1310 tx=0x7f309801c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6303e4dd9d7bb36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6000640 1 -- 172.21.15.16:0/2286772685 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980aa670 con 0x7f30a815df50 2024-04-25T10:39:11.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6000640 1 -- 172.21.15.16:0/2286772685 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30980af070 con 0x7f30a815df50 2024-04-25T10:39:11.501 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.496+0000 7f30a6000640 1 -- 172.21.15.16:0/2286772685 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980aaa70 con 0x7f30a815df50 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- 172.21.15.16:0/2286772685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 msgr2=0x7f30a8159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a8159ea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30a80c1310 tx=0x7f309801c640 comp rx=0 tx=0).stop 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- 172.21.15.16:0/2286772685 shutdown_connections 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c4af0 0x7f30a80cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 --2- 172.21.15.16:0/2286772685 >> v2:172.21.15.186:3300/0 conn(0x7f30a80c30c0 0x7f30a80c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.502 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 --2- 172.21.15.16:0/2286772685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a8159ea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- 172.21.15.16:0/2286772685 >> 172.21.15.16:0/2286772685 conn(0x7f30a8074930 msgr2=0x7f30a806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:11.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- 172.21.15.16:0/2286772685 shutdown_connections 2024-04-25T10:39:11.503 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- 172.21.15.16:0/2286772685 wait complete. 2024-04-25T10:39:11.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 Processor -- start 2024-04-25T10:39:11.504 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.500+0000 7f30ada00640 1 -- start start 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c30c0 0x7f30a8150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a80c4af0 0x7f30a8152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80c34d0 con 0x7f30a815df50 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80cdaa0 con 0x7f30a80c4af0 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f30a80c3650 con 0x7f30a80c30c0 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48440/0 (socket says 172.21.15.16:48440) 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 -- 172.21.15.16:0/1394546441 learned_addr learned my addr 172.21.15.16:0/1394546441 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f309e000640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a80c4af0 0x7f30a8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a6a00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c30c0 0x7f30a8150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 -- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c30c0 msgr2=0x7f30a8150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c30c0 0x7f30a8150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 -- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a80c4af0 msgr2=0x7f30a8152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a80c4af0 0x7f30a8152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 -- 172.21.15.16:0/1394546441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8144430 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30a7400640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007f70 tx=0x7f30a000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a001a070 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0015620 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0015a10 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a814fa60 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a8150020 con 0x7f30a815df50 2024-04-25T10:39:11.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.504+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a81441a0 con 0x7f30a815df50 2024-04-25T10:39:11.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.508+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30a001d070 con 0x7f30a815df50 2024-04-25T10:39:11.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.508+0000 7f309f400640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 0x7f3080071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.508+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f30a008fd60 con 0x7f30a815df50 2024-04-25T10:39:11.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.508+0000 7f30a6a00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 0x7f3080071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.508+0000 7f30a6a00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 0x7f3080071ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30980ae000 tx=0x7f30980a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.512+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30a0010070 con 0x7f30a815df50 2024-04-25T10:39:11.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.680+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f30a80c9910 con 0x7f30a815df50 2024-04-25T10:39:11.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.680+0000 7f309f400640 1 -- 172.21.15.16:0/1394546441 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f30a005c240 con 0x7f30a815df50 2024-04-25T10:39:11.684 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:39:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 msgr2=0x7f3080071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 0x7f3080071ab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30980ae000 tx=0x7f30980a7000 comp rx=0 tx=0).stop 2024-04-25T10:39:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 msgr2=0x7f30a81ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007f70 tx=0x7f30a000d560 comp rx=0 tx=0).stop 2024-04-25T10:39:11.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 shutdown_connections 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f308006f5a0 0x7f3080071ab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30a815df50 0x7f30a81ffdd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30a80c4af0 0x7f30a8152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 --2- 172.21.15.16:0/1394546441 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30a80c30c0 0x7f30a8150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 >> 172.21.15.16:0/1394546441 conn(0x7f30a8074930 msgr2=0x7f30a80ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 shutdown_connections 2024-04-25T10:39:11.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.684+0000 7f30ada00640 1 -- 172.21.15.16:0/1394546441 wait complete. 2024-04-25T10:39:11.706 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:39:11.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.856+0000 7ffa2d000640 1 Processor -- start 2024-04-25T10:39:11.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.856+0000 7ffa2d000640 1 -- start start 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa2d000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa280c67e0 0x7ffa2815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa2d000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa28163800 0x7ffa28165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa2d000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa2815e8b0 con 0x7ffa2815bbe0 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa2d000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffa2815f430 con 0x7ffa280c67e0 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa2d000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2815eb90 con 0x7ffa28163800 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa280c67e0 0x7ffa2815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffa280c67e0 0x7ffa2815b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48450/0 (socket says 172.21.15.16:48450) 2024-04-25T10:39:11.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 -- 172.21.15.16:0/1521744635 learned_addr learned my addr 172.21.15.16:0/1521744635 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:11.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa26800640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa28163800 0x7ffa28165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 -- 172.21.15.16:0/1521744635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa28163800 msgr2=0x7ffa28165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:11.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa28163800 0x7ffa28165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 -- 172.21.15.16:0/1521744635 >> v1:172.21.15.186:6789/0 conn(0x7ffa2815bbe0 legacy=0x7ffa280cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.860+0000 7ffa25e00640 1 -- 172.21.15.16:0/1521744635 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2815ee70 con 0x7ffa280c67e0 2024-04-25T10:39:11.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa25e00640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2815b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009fa0 tx=0x7ffa1801f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1755e8d734fbee62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa25400640 1 -- 172.21.15.16:0/1521744635 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa180b4070 con 0x7ffa280c67e0 2024-04-25T10:39:11.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa25400640 1 -- 172.21.15.16:0/1521744635 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa18007430 con 0x7ffa280c67e0 2024-04-25T10:39:11.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa25400640 1 -- 172.21.15.16:0/1521744635 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18007840 con 0x7ffa280c67e0 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 -- 172.21.15.16:0/1521744635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 msgr2=0x7ffa2815b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2815b6a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009fa0 tx=0x7ffa1801f310 comp rx=0 tx=0).stop 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 -- 172.21.15.16:0/1521744635 shutdown_connections 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa28163800 0x7ffa28165c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1521744635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2815b6a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 -- 172.21.15.16:0/1521744635 >> 172.21.15.16:0/1521744635 conn(0x7ffa280732e0 msgr2=0x7ffa280736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 -- 172.21.15.16:0/1521744635 shutdown_connections 2024-04-25T10:39:11.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.864+0000 7ffa2d000640 1 -- 172.21.15.16:0/1521744635 wait complete. 2024-04-25T10:39:11.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 Processor -- start 2024-04-25T10:39:11.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- start start 2024-04-25T10:39:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa2815bbe0 0x7ffa281f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 0x7ffa2815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2815e4e0 con 0x7ffa280c67e0 2024-04-25T10:39:11.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2815b180 con 0x7ffa28163800 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffa2815e660 con 0x7ffa2815bbe0 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48466/0 (socket says 172.21.15.16:48466) 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 -- 172.21.15.16:0/1538731290 learned_addr learned my addr 172.21.15.16:0/1538731290 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa26800640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 0x7ffa2815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa1d400640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa2815bbe0 0x7ffa281f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 -- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa2815bbe0 msgr2=0x7ffa281f9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa2815bbe0 0x7ffa281f9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 -- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 msgr2=0x7ffa2815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 0x7ffa2815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 -- 172.21.15.16:0/1538731290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa281fa460 con 0x7ffa280c67e0 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa26800640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 0x7ffa2815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:11.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa25e00640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b2040 tx=0x7ffa1801c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa180b4040 con 0x7ffa280c67e0 2024-04-25T10:39:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa180c0070 con 0x7ffa280c67e0 2024-04-25T10:39:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18009550 con 0x7ffa280c67e0 2024-04-25T10:39:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa281f8de0 con 0x7ffa280c67e0 2024-04-25T10:39:11.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.868+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa281f93a0 con 0x7ffa280c67e0 2024-04-25T10:39:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.872+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa280c6ee0 con 0x7ffa280c67e0 2024-04-25T10:39:11.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.872+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffa180ba700 con 0x7ffa280c67e0 2024-04-25T10:39:11.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.872+0000 7ffa1ea00640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 0x7ffa00071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:11.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.872+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffa1812d910 con 0x7ffa280c67e0 2024-04-25T10:39:11.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.872+0000 7ffa1d400640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 0x7ffa00071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:11.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.876+0000 7ffa1d400640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 0x7ffa00071ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa281f33d0 tx=0x7ffa10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:11.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:11.876+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa18018e70 con 0x7ffa280c67e0 2024-04-25T10:39:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.040+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffa280701c0 con 0x7ffa280c67e0 2024-04-25T10:39:12.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.040+0000 7ffa1ea00640 1 -- 172.21.15.16:0/1538731290 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ffa180fa500 con 0x7ffa280c67e0 2024-04-25T10:39:12.045 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 msgr2=0x7ffa00071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 0x7ffa00071ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa281f33d0 tx=0x7ffa10009040 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 msgr2=0x7ffa2814bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b2040 tx=0x7ffa1801c0b0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 shutdown_connections 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffa0006f5d0 0x7ffa00071ae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffa28163800 0x7ffa2815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffa2815bbe0 0x7ffa281f9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 --2- 172.21.15.16:0/1538731290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa280c67e0 0x7ffa2814bc60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 >> 172.21.15.16:0/1538731290 conn(0x7ffa280732e0 msgr2=0x7ffa280c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 shutdown_connections 2024-04-25T10:39:12.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.044+0000 7ffa2d000640 1 -- 172.21.15.16:0/1538731290 wait complete. 2024-04-25T10:39:12.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:39:12.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.220+0000 7fa094000640 1 Processor -- start 2024-04-25T10:39:12.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.220+0000 7fa094000640 1 -- start start 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa094000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa08c1537b0 0x7fa08c15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa094000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa094000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08c153bc0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa094000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c06df90 con 0x7fa08c1537b0 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa094000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0c4930 con 0x7fa08c15cff0 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa090c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa08c1537b0 0x7fa08c15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa091600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa08c0c9cd0 0x7fa08c06d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49338/0 (socket says 172.21.15.16:49338) 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa091600640 1 -- 172.21.15.16:0/4126880820 learned_addr learned my addr 172.21.15.16:0/4126880820 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa092000640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa090c00640 1 -- 172.21.15.16:0/4126880820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 msgr2=0x7fa08c15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:12.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa090c00640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa090c00640 1 -- 172.21.15.16:0/4126880820 >> v1:172.21.15.16:6789/0 conn(0x7fa08c0c9cd0 legacy=0x7fa08c06d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa090c00640 1 -- 172.21.15.16:0/4126880820 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c0c9160 con 0x7fa08c1537b0 2024-04-25T10:39:12.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.224+0000 7fa08be00640 1 -- 172.21.15.16:0/4126880820 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292622619 0 0) 0x7fa08c153bc0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa090c00640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c1537b0 0x7fa08c15cab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa078009900 tx=0x7fa07801ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2861e724c5952ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa08be00640 1 -- 172.21.15.16:0/4126880820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780b5070 con 0x7fa08c1537b0 2024-04-25T10:39:12.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa08be00640 1 -- 172.21.15.16:0/4126880820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0780a8a90 con 0x7fa08c1537b0 2024-04-25T10:39:12.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa08be00640 1 -- 172.21.15.16:0/4126880820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780a8e60 con 0x7fa08c1537b0 2024-04-25T10:39:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- 172.21.15.16:0/4126880820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c1537b0 msgr2=0x7fa08c15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c1537b0 0x7fa08c15cab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa078009900 tx=0x7fa07801ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- 172.21.15.16:0/4126880820 shutdown_connections 2024-04-25T10:39:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 --2- 172.21.15.16:0/4126880820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c1537b0 0x7fa08c15cab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- 172.21.15.16:0/4126880820 >> 172.21.15.16:0/4126880820 conn(0x7fa08c0cb1a0 msgr2=0x7fa08c0716f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- 172.21.15.16:0/4126880820 shutdown_connections 2024-04-25T10:39:12.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- 172.21.15.16:0/4126880820 wait complete. 2024-04-25T10:39:12.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 Processor -- start 2024-04-25T10:39:12.233 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.228+0000 7fa094000640 1 -- start start 2024-04-25T10:39:12.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa08c1537b0 0x7fa08c1fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c1ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c06d3f0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0ca280 con 0x7fa08c1537b0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0c9720 con 0x7fa08c15cff0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48482/0 (socket says 172.21.15.16:48482) 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 -- 172.21.15.16:0/2936395421 learned_addr learned my addr 172.21.15.16:0/2936395421 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa092000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c1ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa090c00640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa08c1537b0 0x7fa08c1fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 -- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 msgr2=0x7fa08c1ebc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c1ebc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 -- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa08c1537b0 msgr2=0x7fa08c1fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa08c1537b0 0x7fa08c1fa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 -- 172.21.15.16:0/2936395421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c1fa730 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa091600640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c560 tx=0x7fa08000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080018070 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0800074e0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c1490d0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080004a30 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c149690 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.232+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c050750 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.236+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa08001b070 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.236+0000 7fa089600640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 0x7fa068071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.236+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa08008ead0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.236+0000 7fa090c00640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 0x7fa068071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.236+0000 7fa090c00640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 0x7fa068071ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0780b2000 tx=0x7fa078008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.240+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa08005b630 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.408+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa08c1501a0 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.408+0000 7fa089600640 1 -- 172.21.15.16:0/2936395421 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fa08005af30 con 0x7fa08c0c9cd0 2024-04-25T10:39:12.412 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 msgr2=0x7fa068071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 0x7fa068071ab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa0780b2000 tx=0x7fa078008040 comp rx=0 tx=0).stop 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 msgr2=0x7fa08c141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c560 tx=0x7fa08000ca20 comp rx=0 tx=0).stop 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 shutdown_connections 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa06806f5a0 0x7fa068071ab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa08c15cff0 0x7fa08c1ebc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa08c1537b0 0x7fa08c1fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 --2- 172.21.15.16:0/2936395421 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa08c0c9cd0 0x7fa08c141450 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 >> 172.21.15.16:0/2936395421 conn(0x7fa08c0cb1a0 msgr2=0x7fa08c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 shutdown_connections 2024-04-25T10:39:12.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.412+0000 7fa094000640 1 -- 172.21.15.16:0/2936395421 wait complete. 2024-04-25T10:39:12.434 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:39:12.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.584+0000 7f138d200640 1 Processor -- start 2024-04-25T10:39:12.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.584+0000 7f138d200640 1 -- start start 2024-04-25T10:39:12.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f138d200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13880cc5d0 0x7f1388166f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f138d200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138815e8b0 con 0x7f13880c67e0 2024-04-25T10:39:12.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f138d200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f138815eb90 con 0x7f13880cc1c0 2024-04-25T10:39:12.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f138d200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f138815f430 con 0x7f13880cc5d0 2024-04-25T10:39:12.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1385e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f13880c67e0 0x7f138815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49348/0 (socket says 172.21.15.16:49348) 2024-04-25T10:39:12.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1385e00640 1 -- 172.21.15.16:0/594360927 learned_addr learned my addr 172.21.15.16:0/594360927 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:12.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1386800640 1 --2- 172.21.15.16:0/594360927 >> v2:172.21.15.186:3300/0 conn(0x7f13880cc5d0 0x7f1388166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1356255709 0 0) 0x7f138815e8b0 con 0x7f13880c67e0 2024-04-25T10:39:12.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f136c0035c0 con 0x7f13880c67e0 2024-04-25T10:39:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1386800640 1 -- 172.21.15.16:0/594360927 >> v1:172.21.15.186:6789/0 conn(0x7f13880cc1c0 legacy=0x7f1388163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3403186464 0 0) 0x7f136c0035c0 con 0x7f13880c67e0 2024-04-25T10:39:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1386800640 1 -- 172.21.15.16:0/594360927 >> v1:172.21.15.16:6789/0 conn(0x7f13880c67e0 legacy=0x7f138815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.588+0000 7f1386800640 1 -- 172.21.15.16:0/594360927 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138815ee70 con 0x7f13880cc5d0 2024-04-25T10:39:12.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f1386800640 1 --2- 172.21.15.16:0/594360927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc5d0 0x7f1388166f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1380009ee0 tx=0x7f138001f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ae0ea19dd0a104 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13800b4070 con 0x7f13880cc5d0 2024-04-25T10:39:12.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13800af400 con 0x7f13880cc5d0 2024-04-25T10:39:12.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f1385400640 1 -- 172.21.15.16:0/594360927 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780016f0 con 0x7f13880cc5d0 2024-04-25T10:39:12.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 -- 172.21.15.16:0/594360927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc5d0 msgr2=0x7f1388166f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 --2- 172.21.15.16:0/594360927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc5d0 0x7f1388166f30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1380009ee0 tx=0x7f138001f180 comp rx=0 tx=0).stop 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 -- 172.21.15.16:0/594360927 shutdown_connections 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 --2- 172.21.15.16:0/594360927 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc5d0 0x7f1388166f30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 -- 172.21.15.16:0/594360927 >> 172.21.15.16:0/594360927 conn(0x7f13880732e0 msgr2=0x7f13880736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 -- 172.21.15.16:0/594360927 shutdown_connections 2024-04-25T10:39:12.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.592+0000 7f138d200640 1 -- 172.21.15.16:0/594360927 wait complete. 2024-04-25T10:39:12.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 Processor -- start 2024-04-25T10:39:12.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- start start 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 0x7f1388151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 0x7f13881558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f13880cc9e0 con 0x7f13880c67e0 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f138815b180 con 0x7f13880cc1c0 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f138815bdb0 con 0x7f13880cc5d0 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48488/0 (socket says 172.21.15.16:48488) 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 -- 172.21.15.16:0/2555334607 learned_addr learned my addr 172.21.15.16:0/2555334607 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f137fe00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 0x7f1388151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1386800640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 0x7f13881558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 -- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 msgr2=0x7f13881558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 0x7f13881558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 -- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 msgr2=0x7f1388151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 0x7f1388151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 -- 172.21.15.16:0/2555334607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13881518c0 con 0x7f13880c67e0 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1386800640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 0x7f13881558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f137fe00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 0x7f1388151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f1385e00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f137800c820 tx=0x7f137800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378018070 con 0x7f13880c67e0 2024-04-25T10:39:12.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1378007500 con 0x7f13880c67e0 2024-04-25T10:39:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378004a30 con 0x7f13880c67e0 2024-04-25T10:39:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13881516b0 con 0x7f13880c67e0 2024-04-25T10:39:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.596+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138814fe10 con 0x7f13880c67e0 2024-04-25T10:39:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.600+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13880c6ee0 con 0x7f13880c67e0 2024-04-25T10:39:12.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.600+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f137801b070 con 0x7f13880c67e0 2024-04-25T10:39:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.600+0000 7f137e000640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 0x7f1360071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.600+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f137808ebb0 con 0x7f13880c67e0 2024-04-25T10:39:12.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.600+0000 7f137fe00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 0x7f1360071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.604+0000 7f137fe00640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 0x7f1360071ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1388153470 tx=0x7f1370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.604+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f137805b680 con 0x7f13880c67e0 2024-04-25T10:39:12.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1388050790 con 0x7f13880c67e0 2024-04-25T10:39:12.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f137e000640 1 -- 172.21.15.16:0/2555334607 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f137805af80 con 0x7f13880c67e0 2024-04-25T10:39:12.775 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 msgr2=0x7f1360071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 0x7f1360071ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1388153470 tx=0x7f1370009040 comp rx=0 tx=0).stop 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 msgr2=0x7f13881eaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f137800c820 tx=0x7f137800cce0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 shutdown_connections 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f136006f5d0 0x7f1360071ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13880cc5d0 0x7f13881558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13880cc1c0 0x7f1388151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 --2- 172.21.15.16:0/2555334607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13880c67e0 0x7f13881eaa00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 >> 172.21.15.16:0/2555334607 conn(0x7f13880732e0 msgr2=0x7f1388159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 shutdown_connections 2024-04-25T10:39:12.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.772+0000 7f138d200640 1 -- 172.21.15.16:0/2555334607 wait complete. 2024-04-25T10:39:12.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:39:12.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 Processor -- start 2024-04-25T10:39:12.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 -- start start 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd67c0cc0c0 0x7fd67c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd67c0cc4d0 0x7fd67c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c1553c0 0x7fd67c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd67c15f4a0 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd67c0cbc40 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.948+0000 7fd683a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c15e5b0 con 0x7fd67c1553c0 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd67c0cc4d0 0x7fd67c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd67c0cc4d0 0x7fd67c154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48494/0 (socket says 172.21.15.16:48494) 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 -- 172.21.15.16:0/3769636309 learned_addr learned my addr 172.21.15.16:0/3769636309 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd681a00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c1553c0 0x7fd67c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd681000640 1 --2- 172.21.15.16:0/3769636309 >> v2:172.21.15.186:3300/0 conn(0x7fd67c0cc0c0 0x7fd67c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 -- 172.21.15.16:0/3769636309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c1553c0 msgr2=0x7fd67c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c1553c0 0x7fd67c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 -- 172.21.15.16:0/3769636309 >> v2:172.21.15.186:3300/0 conn(0x7fd67c0cc0c0 msgr2=0x7fd67c0c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 --2- 172.21.15.16:0/3769636309 >> v2:172.21.15.186:3300/0 conn(0x7fd67c0cc0c0 0x7fd67c0c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 -- 172.21.15.16:0/3769636309 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c15e890 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67be00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc4d0 0x7fd67c154e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0cca30 tx=0x7fd66801ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b950315f9a7e6c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67b400640 1 -- 172.21.15.16:0/3769636309 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6680b5070 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67b400640 1 -- 172.21.15.16:0/3769636309 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6680a8af0 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.952+0000 7fd67b400640 1 -- 172.21.15.16:0/3769636309 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6680b0440 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- 172.21.15.16:0/3769636309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc4d0 msgr2=0x7fd67c154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc4d0 0x7fd67c154e80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0cca30 tx=0x7fd66801ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- 172.21.15.16:0/3769636309 shutdown_connections 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c1553c0 0x7fd67c15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 --2- 172.21.15.16:0/3769636309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc4d0 0x7fd67c154e80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 --2- 172.21.15.16:0/3769636309 >> v2:172.21.15.186:3300/0 conn(0x7fd67c0cc0c0 0x7fd67c0c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- 172.21.15.16:0/3769636309 >> 172.21.15.16:0/3769636309 conn(0x7fd67c0730f0 msgr2=0x7fd67c0735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- 172.21.15.16:0/3769636309 shutdown_connections 2024-04-25T10:39:12.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- 172.21.15.16:0/3769636309 wait complete. 2024-04-25T10:39:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 Processor -- start 2024-04-25T10:39:12.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.956+0000 7fd683a00640 1 -- start start 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c0cc4d0 0x7fd67c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 0x7fd67c1ea630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c15f130 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c15ee50 con 0x7fd67c1553c0 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c0c6d00 con 0x7fd67c0cc4d0 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48496/0 (socket says 172.21.15.16:48496) 2024-04-25T10:39:12.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 -- 172.21.15.16:0/1043593306 learned_addr learned my addr 172.21.15.16:0/1043593306 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd67be00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c0cc4d0 0x7fd67c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 0x7fd67c1ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 -- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c0cc4d0 msgr2=0x7fd67c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c0cc4d0 0x7fd67c15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 -- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 msgr2=0x7fd67c1ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 0x7fd67c1ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 -- 172.21.15.16:0/1043593306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c1eab70 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 0x7fd67c1ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:12.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd681000640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd67000d830 tx=0x7fd67000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670018020 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67000b8d0 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c0ce530 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000bcc0 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c0ceaf0 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.960+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c050750 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.964+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd67001b020 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.964+0000 7fd678c00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 0x7fd658071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.964+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd67008fa60 con 0x7fd67c0cc0c0 2024-04-25T10:39:12.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.964+0000 7fd67be00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 0x7fd658071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:12.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.964+0000 7fd67be00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 0x7fd658071ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6680b2000 tx=0x7fd668008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:12.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:12.968+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd670022030 con 0x7fd67c0cc0c0 2024-04-25T10:39:13.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.144+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd67c158a10 con 0x7fd67c0cc0c0 2024-04-25T10:39:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.144+0000 7fd678c00640 1 -- 172.21.15.16:0/1043593306 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fd67005c590 con 0x7fd67c0cc0c0 2024-04-25T10:39:13.149 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 msgr2=0x7fd658071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 0x7fd658071ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6680b2000 tx=0x7fd668008040 comp rx=0 tx=0).stop 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 msgr2=0x7fd67c1f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd67000d830 tx=0x7fd67000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 shutdown_connections 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd65806f5a0 0x7fd658071ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd67c1553c0 0x7fd67c1ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd67c0cc4d0 0x7fd67c15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 --2- 172.21.15.16:0/1043593306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd67c0cc0c0 0x7fd67c1f63b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 >> 172.21.15.16:0/1043593306 conn(0x7fd67c0730f0 msgr2=0x7fd67c153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 shutdown_connections 2024-04-25T10:39:13.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.148+0000 7fd683a00640 1 -- 172.21.15.16:0/1043593306 wait complete. 2024-04-25T10:39:13.171 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:39:13.172 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:39:13.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.368+0000 7f09d6a00640 1 Processor -- start 2024-04-25T10:39:13.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.368+0000 7f09d6a00640 1 -- start start 2024-04-25T10:39:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d6a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 0x7f09d015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d6a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 0x7f09d01658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d6a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d00b8f60 con 0x7f09d00c68f0 2024-04-25T10:39:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d6a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f09d00b9ac0 con 0x7f09d00c7c40 2024-04-25T10:39:13.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d6a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f09d00b9220 con 0x7f09d00c6d00 2024-04-25T10:39:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09c7400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f09d00c68f0 0x7f09d00c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49358/0 (socket says 172.21.15.16:49358) 2024-04-25T10:39:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09c7400640 1 -- 172.21.15.16:0/2175908548 learned_addr learned my addr 172.21.15.16:0/2175908548 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2175908548 >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 0x7f09d015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d4a00640 1 --2- 172.21.15.16:0/2175908548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 0x7f09d01658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733412517 0 0) 0x7f09d00b8f60 con 0x7f09d00c68f0 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09b40035c0 con 0x7f09d00c68f0 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845368683 0 0) 0x7f09b40035c0 con 0x7f09d00c68f0 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d4a00640 1 -- 172.21.15.16:0/2175908548 >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 msgr2=0x7f09d015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d4a00640 1 --2- 172.21.15.16:0/2175908548 >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 0x7f09d015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d4a00640 1 -- 172.21.15.16:0/2175908548 >> v1:172.21.15.16:6789/0 conn(0x7f09d00c68f0 legacy=0x7f09d00c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09d4a00640 1 -- 172.21.15.16:0/2175908548 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d00b9500 con 0x7f09d00c6d00 2024-04-25T10:39:13.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.372+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2175908548 >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 0x7f09d015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:13.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d4a00640 1 --2- 172.21.15.16:0/2175908548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 0x7f09d01658d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009ee0 tx=0x7f09c801c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=263c40176236f62a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c80b2070 con 0x7f09d00c6d00 2024-04-25T10:39:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c80a5540 con 0x7f09d00c6d00 2024-04-25T10:39:13.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09cf400640 1 -- 172.21.15.16:0/2175908548 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80016d0 con 0x7f09d00c6d00 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 -- 172.21.15.16:0/2175908548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 msgr2=0x7f09d01658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2175908548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 0x7f09d01658d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09c8009ee0 tx=0x7f09c801c900 comp rx=0 tx=0).stop 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 -- 172.21.15.16:0/2175908548 shutdown_connections 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2175908548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c6d00 0x7f09d01658d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2175908548 >> v2:172.21.15.186:3300/0 conn(0x7f09d00c7c40 0x7f09d015b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 -- 172.21.15.16:0/2175908548 >> 172.21.15.16:0/2175908548 conn(0x7f09d00cdc80 msgr2=0x7f09d00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 -- 172.21.15.16:0/2175908548 shutdown_connections 2024-04-25T10:39:13.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.376+0000 7f09d6a00640 1 -- 172.21.15.16:0/2175908548 wait complete. 2024-04-25T10:39:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 Processor -- start 2024-04-25T10:39:13.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- start start 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 0x7f09d00c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09d00c7c40 0x7f09d015a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f09d00c82d0 con 0x7f09d00c6d00 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f09d00c8150 con 0x7f09d00c7c40 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f09d00c9970 con 0x7f09d00c68f0 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48502/0 (socket says 172.21.15.16:48502) 2024-04-25T10:39:13.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 -- 172.21.15.16:0/2505701918 learned_addr learned my addr 172.21.15.16:0/2505701918 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:13.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 0x7f09d00c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d4a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09d00c7c40 0x7f09d015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 -- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 msgr2=0x7f09d00c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 0x7f09d00c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 -- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09d00c7c40 msgr2=0x7f09d015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09d00c7c40 0x7f09d015a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 -- 172.21.15.16:0/2505701918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d0159800 con 0x7f09d00c6d00 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 0x7f09d00c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09c7400640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c870 tx=0x7f09b800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b800ce60 con 0x7f09d00c6d00 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b8005d30 con 0x7f09d00c6d00 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80072b0 con 0x7f09d00c6d00 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d0159ac0 con 0x7f09d00c6d00 2024-04-25T10:39:13.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.380+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d0163e20 con 0x7f09d00c6d00 2024-04-25T10:39:13.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.384+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d013aaa0 con 0x7f09d00c6d00 2024-04-25T10:39:13.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.384+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f09b8007510 con 0x7f09d00c6d00 2024-04-25T10:39:13.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.384+0000 7f09ccc00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 0x7f09a8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.384+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f09b808f460 con 0x7f09d00c6d00 2024-04-25T10:39:13.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.384+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 0x7f09a8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.388+0000 7f09cfe00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 0x7f09a8071ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00095b0 tx=0x7f09c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.388+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09b805c080 con 0x7f09d00c6d00 2024-04-25T10:39:13.560 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.556+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09d0159da0 con 0x7f09d00c6d00 2024-04-25T10:39:13.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.556+0000 7f09ccc00640 1 -- 172.21.15.16:0/2505701918 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f09b805b980 con 0x7f09d00c6d00 2024-04-25T10:39:13.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:13.562 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 msgr2=0x7f09a8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 0x7f09a8071ae0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00095b0 tx=0x7f09c0008040 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 msgr2=0x7f09d01651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09b800c870 tx=0x7f09b800cd30 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 shutdown_connections 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f09a806f5d0 0x7f09a8071ae0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09d00c7c40 0x7f09d015a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d00c6d00 0x7f09d01651e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 --2- 172.21.15.16:0/2505701918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09d00c68f0 0x7f09d00c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 >> 172.21.15.16:0/2505701918 conn(0x7f09d00cdc80 msgr2=0x7f09d0136130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 shutdown_connections 2024-04-25T10:39:13.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.560+0000 7f09d6a00640 1 -- 172.21.15.16:0/2505701918 wait complete. 2024-04-25T10:39:13.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:38:56.312069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:38:57.697392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:39:01.362964+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:39:13.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:39:13.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.740+0000 7f2267800640 1 Processor -- start 2024-04-25T10:39:13.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.740+0000 7f2267800640 1 -- start start 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2267800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 0x7f2260157320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2267800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f226015dfe0 0x7f22601646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2267800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226015a440 con 0x7f226015dbd0 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2267800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f226015d740 con 0x7f226015dfe0 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2267800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f226015acc0 con 0x7f2260159d40 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f226015dfe0 0x7f22601646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f225fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f226015dbd0 0x7f22600c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49372/0 (socket says 172.21.15.16:49372) 2024-04-25T10:39:13.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f225fe00640 1 -- 172.21.15.16:0/3111380126 learned_addr learned my addr 172.21.15.16:0/3111380126 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2264e00640 1 --2- 172.21.15.16:0/3111380126 >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 0x7f2260157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 -- 172.21.15.16:0/3111380126 >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 msgr2=0x7f2260157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 --2- 172.21.15.16:0/3111380126 >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 0x7f2260157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 -- 172.21.15.16:0/3111380126 >> v1:172.21.15.16:6789/0 conn(0x7f226015dbd0 legacy=0x7f22600c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 -- 172.21.15.16:0/3111380126 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226015a700 con 0x7f226015dfe0 2024-04-25T10:39:13.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f225f400640 1 -- 172.21.15.16:0/3111380126 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428465348 0 0) 0x7f226015a440 con 0x7f226015dbd0 2024-04-25T10:39:13.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2264e00640 1 --2- 172.21.15.16:0/3111380126 >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 0x7f2260157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:13.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.744+0000 7f2265800640 1 --2- 172.21.15.16:0/3111380126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601646c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2260073430 tx=0x7f225801f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6061b5075be29421 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f225f400640 1 -- 172.21.15.16:0/3111380126 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580b4070 con 0x7f226015dfe0 2024-04-25T10:39:13.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f225f400640 1 -- 172.21.15.16:0/3111380126 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580af600 con 0x7f226015dfe0 2024-04-25T10:39:13.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f225f400640 1 -- 172.21.15.16:0/3111380126 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580af9d0 con 0x7f226015dfe0 2024-04-25T10:39:13.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- 172.21.15.16:0/3111380126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 msgr2=0x7f22601646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 --2- 172.21.15.16:0/3111380126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601646c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2260073430 tx=0x7f225801f220 comp rx=0 tx=0).stop 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- 172.21.15.16:0/3111380126 shutdown_connections 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 --2- 172.21.15.16:0/3111380126 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601646c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 --2- 172.21.15.16:0/3111380126 >> v2:172.21.15.186:3300/0 conn(0x7f2260159d40 0x7f2260157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- 172.21.15.16:0/3111380126 >> 172.21.15.16:0/3111380126 conn(0x7f226006df70 msgr2=0x7f2260072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- 172.21.15.16:0/3111380126 shutdown_connections 2024-04-25T10:39:13.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- 172.21.15.16:0/3111380126 wait complete. 2024-04-25T10:39:13.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 Processor -- start 2024-04-25T10:39:13.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.748+0000 7f2267800640 1 -- start start 2024-04-25T10:39:13.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2260159d40 0x7f22601e6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f226015dbd0 0x7f22601e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f226015a150 con 0x7f226015dfe0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f226015d3d0 con 0x7f2260159d40 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f22600b4350 con 0x7f226015dbd0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48520/0 (socket says 172.21.15.16:48520) 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 -- 172.21.15.16:0/2896728408 learned_addr learned my addr 172.21.15.16:0/2896728408 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2264e00640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2260159d40 0x7f22601e6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f225fe00640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f226015dbd0 0x7f22601e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 -- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f226015dbd0 msgr2=0x7f22601e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f226015dbd0 0x7f22601e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 -- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2260159d40 msgr2=0x7f22601e6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2260159d40 0x7f22601e6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 -- 172.21.15.16:0/2896728408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226015cd80 con 0x7f226015dfe0 2024-04-25T10:39:13.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2265800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f225801ce50 tx=0x7f225801bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580b4040 con 0x7f226015dfe0 2024-04-25T10:39:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22580c1070 con 0x7f226015dfe0 2024-04-25T10:39:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22601f9010 con 0x7f226015dfe0 2024-04-25T10:39:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22580094e0 con 0x7f226015dfe0 2024-04-25T10:39:13.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22600b0270 con 0x7f226015dfe0 2024-04-25T10:39:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.752+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226015d0b0 con 0x7f226015dfe0 2024-04-25T10:39:13.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.756+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22580ba750 con 0x7f226015dfe0 2024-04-25T10:39:13.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.756+0000 7f225cc00640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 0x7f223c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:13.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.756+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f225812e1f0 con 0x7f226015dfe0 2024-04-25T10:39:13.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.756+0000 7f2264e00640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 0x7f223c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:13.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.756+0000 7f2264e00640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 0x7f223c071ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f225400c900 tx=0x7f2254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:13.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.760+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2258018d80 con 0x7f226015dfe0 2024-04-25T10:39:13.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.924+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22600b0650 con 0x7f226015dfe0 2024-04-25T10:39:13.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f225cc00640 1 -- 172.21.15.16:0/2896728408 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f22580fad50 con 0x7f226015dfe0 2024-04-25T10:39:13.930 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 msgr2=0x7f223c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 0x7f223c071ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f225400c900 tx=0x7f2254008040 comp rx=0 tx=0).stop 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 msgr2=0x7f22601fba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f225801ce50 tx=0x7f225801bfc0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 shutdown_connections 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f223c06f5d0 0x7f223c071ae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f226015dfe0 0x7f22601fba60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f226015dbd0 0x7f22601e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 --2- 172.21.15.16:0/2896728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2260159d40 0x7f22601e6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 >> 172.21.15.16:0/2896728408 conn(0x7f226006df70 msgr2=0x7f22601e8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 shutdown_connections 2024-04-25T10:39:13.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:13.928+0000 7f2267800640 1 -- 172.21.15.16:0/2896728408 wait complete. 2024-04-25T10:39:13.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:39:14.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.104+0000 7ffb8ee00640 1 Processor -- start 2024-04-25T10:39:14.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.104+0000 7ffb8ee00640 1 -- start start 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.104+0000 7ffb8ee00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb8815df50 0x7ffb88159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb8ee00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb8815d4b0 con 0x7ffb880c30c0 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb8ee00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb880c57c0 con 0x7ffb880cd150 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb8ee00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffb8815e360 con 0x7ffb8815df50 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb8815df50 0x7ffb88159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb7fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffb880c30c0 0x7ffb880c45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49388/0 (socket says 172.21.15.16:49388) 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb8815df50 0x7ffb88159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48532/0 (socket says 172.21.15.16:48532) 2024-04-25T10:39:14.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb7fe00640 1 -- 172.21.15.16:0/2982878771 learned_addr learned my addr 172.21.15.16:0/2982878771 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:14.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 -- 172.21.15.16:0/2982878771 >> v1:172.21.15.186:6789/0 conn(0x7ffb880cd150 legacy=0x7ffb880cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:14.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 -- 172.21.15.16:0/2982878771 >> v1:172.21.15.16:6789/0 conn(0x7ffb880c30c0 legacy=0x7ffb880c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 -- 172.21.15.16:0/2982878771 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb880c5aa0 con 0x7ffb8815df50 2024-04-25T10:39:14.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87e00640 1 --2- 172.21.15.16:0/2982878771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb8815df50 0x7ffb88159ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb88073560 tx=0x7ffb7801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36af3142f4da41c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87400640 1 -- 172.21.15.16:0/2982878771 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780a7070 con 0x7ffb8815df50 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87400640 1 -- 172.21.15.16:0/2982878771 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780b0070 con 0x7ffb8815df50 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.108+0000 7ffb87400640 1 -- 172.21.15.16:0/2982878771 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780ab8d0 con 0x7ffb8815df50 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- 172.21.15.16:0/2982878771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb8815df50 msgr2=0x7ffb88159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/2982878771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb8815df50 0x7ffb88159ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb88073560 tx=0x7ffb7801c560 comp rx=0 tx=0).stop 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- 172.21.15.16:0/2982878771 shutdown_connections 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/2982878771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb8815df50 0x7ffb88159ea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- 172.21.15.16:0/2982878771 >> 172.21.15.16:0/2982878771 conn(0x7ffb88074930 msgr2=0x7ffb8806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- 172.21.15.16:0/2982878771 shutdown_connections 2024-04-25T10:39:14.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- 172.21.15.16:0/2982878771 wait complete. 2024-04-25T10:39:14.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 Processor -- start 2024-04-25T10:39:14.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.112+0000 7ffb8ee00640 1 -- start start 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb880cd150 0x7ffb88151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb8815df50 0x7ffb88151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb880c4cc0 con 0x7ffb880c30c0 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8815dac0 con 0x7ffb8815df50 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffb880c4e40 con 0x7ffb880cd150 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48540/0 (socket says 172.21.15.16:48540) 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 -- 172.21.15.16:0/3309148786 learned_addr learned my addr 172.21.15.16:0/3309148786 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ce00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb8815df50 0x7ffb88151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb7fe00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb880cd150 0x7ffb88151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 -- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb880cd150 msgr2=0x7ffb88151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb880cd150 0x7ffb88151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 -- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb8815df50 msgr2=0x7ffb88151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb8815df50 0x7ffb88151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 -- 172.21.15.16:0/3309148786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8815bcb0 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb87e00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffb780ad040 tx=0x7ffb7801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78006e60 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780b5810 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8815d280 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780b5c00 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb881fc740 con 0x7ffb880c30c0 2024-04-25T10:39:14.121 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.116+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb88050750 con 0x7ffb880c30c0 2024-04-25T10:39:14.122 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.120+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb780bd020 con 0x7ffb880c30c0 2024-04-25T10:39:14.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.120+0000 7ffb84c00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 0x7ffb60071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.120+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffb78129f30 con 0x7ffb880c30c0 2024-04-25T10:39:14.123 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.120+0000 7ffb7fe00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 0x7ffb60071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.124 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.120+0000 7ffb7fe00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 0x7ffb60071ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb8814f5f0 tx=0x7ffb70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.124+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb78016150 con 0x7ffb880c30c0 2024-04-25T10:39:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.288+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffb8815b350 con 0x7ffb880c30c0 2024-04-25T10:39:14.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.288+0000 7ffb84c00640 1 -- 172.21.15.16:0/3309148786 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ffb780f6a00 con 0x7ffb880c30c0 2024-04-25T10:39:14.292 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 msgr2=0x7ffb60071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 0x7ffb60071ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffb8814f5f0 tx=0x7ffb70009040 comp rx=0 tx=0).stop 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 msgr2=0x7ffb8815b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffb780ad040 tx=0x7ffb7801ada0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 shutdown_connections 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb6006f5a0 0x7ffb60071ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb8815df50 0x7ffb88151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb880cd150 0x7ffb88151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 --2- 172.21.15.16:0/3309148786 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb880c30c0 0x7ffb8815b770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 >> 172.21.15.16:0/3309148786 conn(0x7ffb88074930 msgr2=0x7ffb880cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:14.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 shutdown_connections 2024-04-25T10:39:14.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.292+0000 7ffb8ee00640 1 -- 172.21.15.16:0/3309148786 wait complete. 2024-04-25T10:39:14.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:39:14.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.468+0000 7f835f400640 1 Processor -- start 2024-04-25T10:39:14.472 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.468+0000 7f835f400640 1 -- start start 2024-04-25T10:39:14.474 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.468+0000 7f835f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83581552b0 0x7f83580c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835f400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83580c9800 0x7f83581658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835f400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83580cb560 con 0x7f83580c93f0 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835f400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f83580c51e0 con 0x7f83581552b0 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835f400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f83580c2470 con 0x7f83580c9800 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83581552b0 0x7f83580c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83581552b0 0x7f83580c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48552/0 (socket says 172.21.15.16:48552) 2024-04-25T10:39:14.475 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 -- 172.21.15.16:0/1729647208 learned_addr learned my addr 172.21.15.16:0/1729647208 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:14.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835d400640 1 --2- 172.21.15.16:0/1729647208 >> v2:172.21.15.186:3300/0 conn(0x7f83580c9800 0x7f83581658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 -- 172.21.15.16:0/1729647208 >> v2:172.21.15.186:3300/0 conn(0x7f83580c9800 msgr2=0x7f83581658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:14.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 --2- 172.21.15.16:0/1729647208 >> v2:172.21.15.186:3300/0 conn(0x7f83580c9800 0x7f83581658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 -- 172.21.15.16:0/1729647208 >> v1:172.21.15.186:6789/0 conn(0x7f83580c93f0 legacy=0x7f83580c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 -- 172.21.15.16:0/1729647208 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83580ca6a0 con 0x7f83581552b0 2024-04-25T10:39:14.477 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.472+0000 7f835ca00640 1 --2- 172.21.15.16:0/1729647208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83581552b0 0x7f83580c4ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f835815afc0 tx=0x7f834c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33004ef5667f2b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.478 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f8357400640 1 -- 172.21.15.16:0/1729647208 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a8660 con 0x7f83581552b0 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f8357400640 1 -- 172.21.15.16:0/1729647208 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c0a8800 con 0x7f83581552b0 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f8357400640 1 -- 172.21.15.16:0/1729647208 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0a8c10 con 0x7f83581552b0 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- 172.21.15.16:0/1729647208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83581552b0 msgr2=0x7f83580c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 --2- 172.21.15.16:0/1729647208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83581552b0 0x7f83580c4ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f835815afc0 tx=0x7f834c01c640 comp rx=0 tx=0).stop 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- 172.21.15.16:0/1729647208 shutdown_connections 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 --2- 172.21.15.16:0/1729647208 >> v2:172.21.15.186:3300/0 conn(0x7f83580c9800 0x7f83581658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 --2- 172.21.15.16:0/1729647208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83581552b0 0x7f83580c4ca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- 172.21.15.16:0/1729647208 >> 172.21.15.16:0/1729647208 conn(0x7f835806dd80 msgr2=0x7f8358072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- 172.21.15.16:0/1729647208 shutdown_connections 2024-04-25T10:39:14.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- 172.21.15.16:0/1729647208 wait complete. 2024-04-25T10:39:14.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 Processor -- start 2024-04-25T10:39:14.481 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.476+0000 7f835f400640 1 -- start start 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83580c9800 0x7f835814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83581552b0 0x7f835814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f83581556c0 con 0x7f83580c93f0 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83580c1f50 con 0x7f83580c9800 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f83580c9c10 con 0x7f83581552b0 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48556/0 (socket says 172.21.15.16:48556) 2024-04-25T10:39:14.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 -- 172.21.15.16:0/132522227 learned_addr learned my addr 172.21.15.16:0/132522227 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f8357e00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83580c9800 0x7f835814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835d400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83581552b0 0x7f835814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 -- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83581552b0 msgr2=0x7f835814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83581552b0 0x7f835814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 -- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83580c9800 msgr2=0x7f835814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83580c9800 0x7f835814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 -- 172.21.15.16:0/132522227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835814d440 con 0x7f83580c93f0 2024-04-25T10:39:14.484 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835ca00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f834c01a270 tx=0x7f834c0193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0b08d0 con 0x7f83580c93f0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f834c0b0a90 con 0x7f83580c93f0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c0ba440 con 0x7f83580c93f0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835815dae0 con 0x7f83580c93f0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835814ee40 con 0x7f83580c93f0 2024-04-25T10:39:14.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.480+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8358050750 con 0x7f83580c93f0 2024-04-25T10:39:14.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.484+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f834c0a6400 con 0x7f83580c93f0 2024-04-25T10:39:14.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.484+0000 7f8354c00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 0x7f8334071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.484+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f834c12a080 con 0x7f83580c93f0 2024-04-25T10:39:14.487 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.484+0000 7f8357e00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 0x7f8334071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.484+0000 7f8357e00640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 0x7f8334071ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835815c0c0 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.491 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.488+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f834c0ac030 con 0x7f83580c93f0 2024-04-25T10:39:14.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.652+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f83580c46e0 con 0x7f83580c93f0 2024-04-25T10:39:14.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.652+0000 7f8354c00640 1 -- 172.21.15.16:0/132522227 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f834c016230 con 0x7f83580c93f0 2024-04-25T10:39:14.656 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-25T10:39:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 msgr2=0x7f8334071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 0x7f8334071ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f835815c0c0 tx=0x7f8344009040 comp rx=0 tx=0).stop 2024-04-25T10:39:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 msgr2=0x7f835814a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f834c01a270 tx=0x7f834c0193e0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 shutdown_connections 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f833406f5a0 0x7f8334071ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83581552b0 0x7f835814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83580c9800 0x7f835814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 --2- 172.21.15.16:0/132522227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83580c93f0 0x7f835814a810 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 >> 172.21.15.16:0/132522227 conn(0x7f835806dd80 msgr2=0x7f8358152b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 shutdown_connections 2024-04-25T10:39:14.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.656+0000 7f835f400640 1 -- 172.21.15.16:0/132522227 wait complete. 2024-04-25T10:39:14.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:39:14.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.828+0000 7f0352a00640 1 Processor -- start 2024-04-25T10:39:14.833 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.828+0000 7f0352a00640 1 -- start start 2024-04-25T10:39:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0352a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f034c159ea0 0x7f034c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0352a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c15d4b0 con 0x7f034c0c4af0 2024-04-25T10:39:14.835 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0352a00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c0c57c0 con 0x7f034c15df50 2024-04-25T10:39:14.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0352a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f034c15e360 con 0x7f034c159ea0 2024-04-25T10:39:14.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0350a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f034c0c4af0 0x7f034c0cd150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60750/0 (socket says 172.21.15.16:60750) 2024-04-25T10:39:14.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0350a00640 1 -- 172.21.15.16:0/2605211138 learned_addr learned my addr 172.21.15.16:0/2605211138 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:14.836 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0343e00640 1 --2- 172.21.15.16:0/2605211138 >> v2:172.21.15.186:3300/0 conn(0x7f034c159ea0 0x7f034c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192050838 0 0) 0x7f034c15d4b0 con 0x7f034c0c4af0 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03300035c0 con 0x7f034c0c4af0 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3626400005 0 0) 0x7f03300035c0 con 0x7f034c0c4af0 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0343e00640 1 -- 172.21.15.16:0/2605211138 >> v1:172.21.15.186:6789/0 conn(0x7f034c15df50 legacy=0x7f034c0c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0343e00640 1 -- 172.21.15.16:0/2605211138 >> v1:172.21.15.16:6789/0 conn(0x7f034c0c4af0 legacy=0x7f034c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.832+0000 7f0343e00640 1 -- 172.21.15.16:0/2605211138 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c0c5aa0 con 0x7f034c159ea0 2024-04-25T10:39:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0343e00640 1 --2- 172.21.15.16:0/2605211138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c0c45b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0334009900 tx=0x7f033401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f11c1d211511fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b5070 con 0x7f034c159ea0 2024-04-25T10:39:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340a8770 con 0x7f034c159ea0 2024-04-25T10:39:14.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f034b400640 1 -- 172.21.15.16:0/2605211138 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0344001a70 con 0x7f034c159ea0 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 -- 172.21.15.16:0/2605211138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 msgr2=0x7f034c0c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 --2- 172.21.15.16:0/2605211138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c0c45b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0334009900 tx=0x7f033401ecb0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 -- 172.21.15.16:0/2605211138 shutdown_connections 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 --2- 172.21.15.16:0/2605211138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c0c45b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 -- 172.21.15.16:0/2605211138 >> 172.21.15.16:0/2605211138 conn(0x7f034c074930 msgr2=0x7f034c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 -- 172.21.15.16:0/2605211138 shutdown_connections 2024-04-25T10:39:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.836+0000 7f0352a00640 1 -- 172.21.15.16:0/2605211138 wait complete. 2024-04-25T10:39:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 Processor -- start 2024-04-25T10:39:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 -- start start 2024-04-25T10:39:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c1f9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f034c15df50 0x7f034c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15a2b0 con 0x7f034c0c4af0 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15dac0 con 0x7f034c159ea0 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0352a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f034c0c5d80 con 0x7f034c15df50 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f034be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f034be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55116/0 (socket says 172.21.15.16:55116) 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f034be00640 1 -- 172.21.15.16:0/1677071426 learned_addr learned my addr 172.21.15.16:0/1677071426 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0343e00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c1f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f0350a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f034c15df50 0x7f034c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.840+0000 7f034be00640 1 -- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f034c15df50 msgr2=0x7f034c150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f034be00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f034c15df50 0x7f034c150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f034be00640 1 -- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 msgr2=0x7f034c1f9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f034be00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c1f9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f034be00640 1 -- 172.21.15.16:0/1677071426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c1512c0 con 0x7f034c0c4af0 2024-04-25T10:39:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0343e00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c1f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:14.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f034be00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f033c00c560 tx=0x7f033c00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0052d0 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c005470 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c012870 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c1ea870 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c150580 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c050750 con 0x7f034c0c4af0 2024-04-25T10:39:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.844+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f033c012a90 con 0x7f034c0c4af0 2024-04-25T10:39:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.848+0000 7f0348c00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 0x7f0324071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.848+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f033c08f210 con 0x7f034c0c4af0 2024-04-25T10:39:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.848+0000 7f0343e00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 0x7f0324071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.848+0000 7f0343e00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 0x7f0324071ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03340b2000 tx=0x7f0334008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:14.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:14.852+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f033c05be40 con 0x7f034c0c4af0 2024-04-25T10:39:15.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f034c1ec8e0 con 0x7f034c0c4af0 2024-04-25T10:39:15.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0348c00640 1 -- 172.21.15.16:0/1677071426 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f033c05b740 con 0x7f034c0c4af0 2024-04-25T10:39:15.023 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 msgr2=0x7f0324071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 0x7f0324071ae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03340b2000 tx=0x7f0334008040 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 msgr2=0x7f034c1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f033c00c560 tx=0x7f033c00ca20 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 shutdown_connections 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f032406f5d0 0x7f0324071ae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f034c15df50 0x7f034c150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f034c159ea0 0x7f034c1f9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 --2- 172.21.15.16:0/1677071426 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0c4af0 0x7f034c1514d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 >> 172.21.15.16:0/1677071426 conn(0x7f034c074930 msgr2=0x7f034c159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 shutdown_connections 2024-04-25T10:39:15.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.016+0000 7f0352a00640 1 -- 172.21.15.16:0/1677071426 wait complete. 2024-04-25T10:39:15.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:39:15.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 Processor -- start 2024-04-25T10:39:15.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 -- start start 2024-04-25T10:39:15.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff45806d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45806eba0 con 0x7ff45806e4b0 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45806ee80 con 0x7ff4580cb9a0 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff45e000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff45806e970 con 0x7ff4580c7490 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff457400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff45806e4b0 0x7ff4580cbef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60756/0 (socket says 172.21.15.16:60756) 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff457400640 1 -- 172.21.15.16:0/2668908170 learned_addr learned my addr 172.21.15.16:0/2668908170 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff457e00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff45806d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523931309 0 0) 0x7ff45806eba0 con 0x7ff45806e4b0 2024-04-25T10:39:15.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff43c0035c0 con 0x7ff45806e4b0 2024-04-25T10:39:15.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3002396471 0 0) 0x7ff43c0035c0 con 0x7ff45806e4b0 2024-04-25T10:39:15.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 msgr2=0x7ff45806d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:15.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff45806d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 >> v1:172.21.15.186:6789/0 conn(0x7ff4580cb9a0 legacy=0x7ff4580c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45806f160 con 0x7ff45806e4b0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7ff4480016d0 con 0x7ff45806e4b0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 >> v1:172.21.15.16:6789/0 conn(0x7ff45806e4b0 legacy=0x7ff4580cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff43c003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43c003fe0 0x7ff43c0048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff43c004de0 0x7ff43c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c00bb90 con 0x7ff43c004de0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c00bd40 con 0x7ff43c003fe0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c00bf40 con 0x7ff4580c7490 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.192+0000 7ff457e00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff43c004de0 0x7ff43c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457400640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff43c003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff456a00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43c003fe0 0x7ff43c0048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 -- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 msgr2=0x7ff43c003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580c7490 0x7ff43c003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 -- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43c003fe0 msgr2=0x7ff43c0048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff43c003fe0 0x7ff43c0048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 -- 172.21.15.16:0/2668908170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c0035c0 con 0x7ff43c004de0 2024-04-25T10:39:15.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff43c004de0 0x7ff43c0051f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff45000e190 tx=0x7ff45001cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6419cc56231b05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4500b2070 con 0x7ff43c004de0 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4500a5d30 con 0x7ff43c004de0 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff456000640 1 -- 172.21.15.16:0/2668908170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450009ca0 con 0x7ff43c004de0 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff45e000640 1 -- 172.21.15.16:0/2668908170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff43c004de0 msgr2=0x7ff43c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff45e000640 1 --2- 172.21.15.16:0/2668908170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff43c004de0 0x7ff43c0051f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff45000e190 tx=0x7ff45001cd20 comp rx=0 tx=0).stop 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.196+0000 7ff457e00640 1 -- 172.21.15.16:0/2668908170 reap_dead start 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 -- 172.21.15.16:0/2668908170 shutdown_connections 2024-04-25T10:39:15.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 -- 172.21.15.16:0/2668908170 >> 172.21.15.16:0/2668908170 conn(0x7ff4580730f0 msgr2=0x7ff4580735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:15.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 -- 172.21.15.16:0/2668908170 shutdown_connections 2024-04-25T10:39:15.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 -- 172.21.15.16:0/2668908170 wait complete. 2024-04-25T10:39:15.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 Processor -- start 2024-04-25T10:39:15.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.200+0000 7ff45e000640 1 -- start start 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 0x7ff4580b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580af0c0 0x7ff4581fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4580c6860 con 0x7ff45814b470 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff45806f720 con 0x7ff4580c2f10 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff4580cc600 con 0x7ff4580af0c0 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55144/0 (socket says 172.21.15.16:55144) 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 -- 172.21.15.16:0/1020628673 learned_addr learned my addr 172.21.15.16:0/1020628673 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:15.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457400640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 0x7ff4580b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff456a00640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580af0c0 0x7ff4581fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 -- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580af0c0 msgr2=0x7ff4581fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580af0c0 0x7ff4581fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 -- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 msgr2=0x7ff4580b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 0x7ff4580b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 -- 172.21.15.16:0/1020628673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4580b1930 con 0x7ff45814b470 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457400640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 0x7ff4580b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff457e00640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4500b0040 tx=0x7ff450009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4500b2040 con 0x7ff45814b470 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4500a5b30 con 0x7ff45814b470 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450009ca0 con 0x7ff45814b470 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4580c4820 con 0x7ff45814b470 2024-04-25T10:39:15.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4580c4de0 con 0x7ff45814b470 2024-04-25T10:39:15.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff458050750 con 0x7ff45814b470 2024-04-25T10:39:15.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.204+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff4500b6410 con 0x7ff45814b470 2024-04-25T10:39:15.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.208+0000 7ff44f400640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 0x7ff430071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:15.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.208+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff450129430 con 0x7ff45814b470 2024-04-25T10:39:15.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.208+0000 7ff457400640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 0x7ff430071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:15.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.208+0000 7ff457400640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 0x7ff430071ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff45815e500 tx=0x7ff448009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:15.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.212+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff450016a30 con 0x7ff45814b470 2024-04-25T10:39:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4581fbfa0 con 0x7ff45814b470 2024-04-25T10:39:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff44f400640 1 -- 172.21.15.16:0/1020628673 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7ff4500a5d00 con 0x7ff45814b470 2024-04-25T10:39:15.395 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-25T10:39:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 msgr2=0x7ff430071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 0x7ff430071ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff45815e500 tx=0x7ff448009040 comp rx=0 tx=0).stop 2024-04-25T10:39:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 msgr2=0x7ff45814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff4500b0040 tx=0x7ff450009790 comp rx=0 tx=0).stop 2024-04-25T10:39:15.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 shutdown_connections 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43006f5d0 0x7ff430071ae0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45814b470 0x7ff45814b880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4580af0c0 0x7ff4581fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 --2- 172.21.15.16:0/1020628673 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4580c2f10 0x7ff4580b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 >> 172.21.15.16:0/1020628673 conn(0x7ff4580730f0 msgr2=0x7ff4580cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 shutdown_connections 2024-04-25T10:39:15.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:15.392+0000 7ff45e000640 1 -- 172.21.15.16:0/1020628673 wait complete. 2024-04-25T10:39:15.417 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi016.front.sepia.ceph.com... 2024-04-25T10:39:15.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:15.418 DEBUG:teuthology.orchestra.run.smithi016:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:39:15.441 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi016.stderr:ceph-fuse[32051]: fuse finished with error 0 and tester_r 0 2024-04-25T10:39:15.443 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:39:17.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:39:17.540 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:39:21.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T10:39:21.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:21.545 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T10:39:21.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:21.779 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 Processor -- start 2024-04-25T10:39:21.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 -- start start 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640c80f0 0x7fea641551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea640cbea0 0x7fea640cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 0x7fea6415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fea640c7910 con 0x7fea640cbea0 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fea640c6bc0 con 0x7fea6415e7a0 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea69800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fea640c6e80 con 0x7fea640c80f0 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea5a000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea640cbea0 0x7fea640cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea5a000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea640cbea0 0x7fea640cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55160/0 (socket says 172.21.15.16:55160) 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.775+0000 7fea5a000640 1 -- 172.21.15.16:0/4256803021 learned_addr learned my addr 172.21.15.16:0/4256803021 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea63400640 1 --2- 172.21.15.16:0/4256803021 >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 0x7fea6415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea62a00640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640c80f0 0x7fea641551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 -- 172.21.15.16:0/4256803021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640c80f0 msgr2=0x7fea641551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640c80f0 0x7fea641551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 -- 172.21.15.16:0/4256803021 >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 msgr2=0x7fea6415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 --2- 172.21.15.16:0/4256803021 >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 0x7fea6415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 -- 172.21.15.16:0/4256803021 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640c7630 con 0x7fea640cbea0 2024-04-25T10:39:21.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea63400640 1 --2- 172.21.15.16:0/4256803021 >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 0x7fea6415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:21.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea5a000640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640cbea0 0x7fea640cc2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea640744c0 tx=0x7fea4c01ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01fe2b95a3f8a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:21.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea62000640 1 -- 172.21.15.16:0/4256803021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0b5070 con 0x7fea640cbea0 2024-04-25T10:39:21.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea62000640 1 -- 172.21.15.16:0/4256803021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4c0a8af0 con 0x7fea640cbea0 2024-04-25T10:39:21.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.779+0000 7fea62000640 1 -- 172.21.15.16:0/4256803021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0b0440 con 0x7fea640cbea0 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- 172.21.15.16:0/4256803021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640cbea0 msgr2=0x7fea640cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640cbea0 0x7fea640cc2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fea640744c0 tx=0x7fea4c01ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- 172.21.15.16:0/4256803021 shutdown_connections 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 --2- 172.21.15.16:0/4256803021 >> v2:172.21.15.186:3300/0 conn(0x7fea6415e7a0 0x7fea6415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640cbea0 0x7fea640cc2b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 --2- 172.21.15.16:0/4256803021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640c80f0 0x7fea641551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- 172.21.15.16:0/4256803021 >> 172.21.15.16:0/4256803021 conn(0x7fea64073160 msgr2=0x7fea64073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:21.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- 172.21.15.16:0/4256803021 shutdown_connections 2024-04-25T10:39:21.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- 172.21.15.16:0/4256803021 wait complete. 2024-04-25T10:39:21.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 Processor -- start 2024-04-25T10:39:21.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.783+0000 7fea69800640 1 -- start start 2024-04-25T10:39:21.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 0x7fea641561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea6415e7a0 0x7fea64156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea64155700 con 0x7fea640c80f0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fea6415f0f0 con 0x7fea6415e7a0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fea640cb9d0 con 0x7fea640cbea0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55174/0 (socket says 172.21.15.16:55174) 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 -- 172.21.15.16:0/4158988271 learned_addr learned my addr 172.21.15.16:0/4158988271 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5a000640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 0x7fea641561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea63400640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea6415e7a0 0x7fea64156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 -- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 msgr2=0x7fea641561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 0x7fea641561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 -- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea6415e7a0 msgr2=0x7fea64156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea6415e7a0 0x7fea64156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 -- 172.21.15.16:0/4158988271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641f9330 con 0x7fea640c80f0 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5a000640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 0x7fea641561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:21.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea62a00640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea5400d800 tx=0x7fea5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5400b8d0 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5400ba70 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6414f850 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5400be60 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641fc2e0 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea64050750 con 0x7fea640c80f0 2024-04-25T10:39:21.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.787+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fea54014410 con 0x7fea640c80f0 2024-04-25T10:39:21.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.791+0000 7fea5b400640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 0x7fea3c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:21.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.791+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fea54090090 con 0x7fea640c80f0 2024-04-25T10:39:21.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.791+0000 7fea5a000640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 0x7fea3c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:21.796 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.791+0000 7fea5a000640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 0x7fea3c071ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0b2000 tx=0x7fea4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:21.799 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.795+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea5405cb60 con 0x7fea640c80f0 2024-04-25T10:39:21.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.959+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea641f9500 con 0x7fea640c80f0 2024-04-25T10:39:21.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea5b400640 1 -- 172.21.15.16:0/4158988271 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fea5405c460 con 0x7fea640c80f0 2024-04-25T10:39:21.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:21.966 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 msgr2=0x7fea3c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 0x7fea3c071ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0b2000 tx=0x7fea4c008040 comp rx=0 tx=0).stop 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 msgr2=0x7fea641f8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fea5400d800 tx=0x7fea5400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 shutdown_connections 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea3c06f5a0 0x7fea3c071ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea6415e7a0 0x7fea64156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea640cbea0 0x7fea641561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 --2- 172.21.15.16:0/4158988271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea640c80f0 0x7fea641f8df0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 >> 172.21.15.16:0/4158988271 conn(0x7fea64073160 msgr2=0x7fea640ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 shutdown_connections 2024-04-25T10:39:21.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:21.963+0000 7fea69800640 1 -- 172.21.15.16:0/4158988271 wait complete. 2024-04-25T10:39:21.989 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:22.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 Processor -- start 2024-04-25T10:39:22.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 -- start start 2024-04-25T10:39:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 0x7fbdbc0c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdbc0c5440 con 0x7fbdbc153fc0 2024-04-25T10:39:22.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fbdbc0c7c40 con 0x7fbdbc0c5030 2024-04-25T10:39:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.135+0000 7fbdc3000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc0ca9e0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdc1000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 0x7fbdbc0c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdbbe00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbdbc153fc0 0x7fbdbc0c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:39746/0 (socket says 172.21.15.16:39746) 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdc1000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:60882/0 (socket says 172.21.15.16:60882) 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdbbe00640 1 -- 172.21.15.16:0/1323673804 learned_addr learned my addr 172.21.15.16:0/1323673804 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 -- 172.21.15.16:0/1323673804 >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 msgr2=0x7fbdbc1647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 --2- 172.21.15.16:0/1323673804 >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 -- 172.21.15.16:0/1323673804 >> v1:172.21.15.186:6789/0 conn(0x7fbdbc153fc0 legacy=0x7fbdbc0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 -- 172.21.15.16:0/1323673804 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc0c7e90 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdc1000640 1 --2- 172.21.15.16:0/1323673804 >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:22.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.139+0000 7fbdb3e00640 1 --2- 172.21.15.16:0/1323673804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 0x7fbdbc0c4af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009900 tx=0x7fbda401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89dbd6b0d86ab978 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdbb400640 1 -- 172.21.15.16:0/1323673804 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda40b1070 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdbb400640 1 -- 172.21.15.16:0/1323673804 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda40ac600 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.146 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdbb400640 1 -- 172.21.15.16:0/1323673804 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda40aca10 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- 172.21.15.16:0/1323673804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 msgr2=0x7fbdbc0c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 --2- 172.21.15.16:0/1323673804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 0x7fbdbc0c4af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009900 tx=0x7fbda401c5a0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- 172.21.15.16:0/1323673804 shutdown_connections 2024-04-25T10:39:22.147 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 --2- 172.21.15.16:0/1323673804 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c46e0 0x7fbdbc0c4af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 --2- 172.21.15.16:0/1323673804 >> v2:172.21.15.186:3300/0 conn(0x7fbdbc0c5030 0x7fbdbc1647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- 172.21.15.16:0/1323673804 >> 172.21.15.16:0/1323673804 conn(0x7fbdbc0cdc80 msgr2=0x7fbdbc0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- 172.21.15.16:0/1323673804 shutdown_connections 2024-04-25T10:39:22.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- 172.21.15.16:0/1323673804 wait complete. 2024-04-25T10:39:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 Processor -- start 2024-04-25T10:39:22.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.143+0000 7fbdc3000640 1 -- start start 2024-04-25T10:39:22.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c5030 0x7fbdbc1fed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdbc153fc0 0x7fbdbc1ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15ae60 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15ace0 con 0x7fbdbc153fc0 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc1543d0 con 0x7fbdbc0c5030 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55188/0 (socket says 172.21.15.16:55188) 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 -- 172.21.15.16:0/3428440555 learned_addr learned my addr 172.21.15.16:0/3428440555 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdb3e00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c5030 0x7fbdbc1fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc1000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdbc153fc0 0x7fbdbc1ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 -- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c5030 msgr2=0x7fbdbc1fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c5030 0x7fbdbc1fed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 -- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdbc153fc0 msgr2=0x7fbdbc1ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdbc153fc0 0x7fbdbc1ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 -- 172.21.15.16:0/3428440555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc14aba0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdbbe00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0058d0 tx=0x7fbdac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac017070 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdac005d30 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc14a290 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0072b0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc163bd0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.147+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc050750 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.154 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.151+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbdac01a070 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.151+0000 7fbdb8c00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 0x7fbd94071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.151+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbdac08ea10 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.156 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.151+0000 7fbdb3e00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 0x7fbd94071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.157 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.151+0000 7fbdb3e00640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 0x7fbd94071ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbda40ae000 tx=0x7fbda40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.160 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.155+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbdbc14aba0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.319+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdbc06e1f0 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdb8c00640 1 -- 172.21.15.16:0/3428440555 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fbdac05ae10 con 0x7fbdbc0c46e0 2024-04-25T10:39:22.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:22.327 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 msgr2=0x7fbd94071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 0x7fbd94071ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbda40ae000 tx=0x7fbda40a7000 comp rx=0 tx=0).stop 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 msgr2=0x7fbdbc149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0058d0 tx=0x7fbdac00c970 comp rx=0 tx=0).stop 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 shutdown_connections 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbd9406f5a0 0x7fbd94071ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbdbc153fc0 0x7fbdbc1ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbdbc0c5030 0x7fbdbc1fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 --2- 172.21.15.16:0/3428440555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdbc0c46e0 0x7fbdbc149d50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 >> 172.21.15.16:0/3428440555 conn(0x7fbdbc0cdc80 msgr2=0x7fbdbc0c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 shutdown_connections 2024-04-25T10:39:22.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.323+0000 7fbdc3000640 1 -- 172.21.15.16:0/3428440555 wait complete. 2024-04-25T10:39:22.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:39:22.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.499+0000 7fc63fe00640 1 Processor -- start 2024-04-25T10:39:22.506 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.499+0000 7fc63fe00640 1 -- start start 2024-04-25T10:39:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63fe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc6400c6650 0x7fc6400c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63fe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc640155660 con 0x7fc6400cb810 2024-04-25T10:39:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63fe00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64015e430 con 0x7fc64015aec0 2024-04-25T10:39:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63fe00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fc64015f020 con 0x7fc6400c6650 2024-04-25T10:39:22.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63f400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc6400cb810 0x7fc6400cbc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60758/0 (socket says 172.21.15.16:60758) 2024-04-25T10:39:22.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63f400640 1 -- 172.21.15.16:0/1482145552 learned_addr learned my addr 172.21.15.16:0/1482145552 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:22.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1482145552 >> v2:172.21.15.186:3300/0 conn(0x7fc6400c6650 0x7fc6400c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504092263 0 0) 0x7fc640155660 con 0x7fc6400cb810 2024-04-25T10:39:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6240035c0 con 0x7fc6400cb810 2024-04-25T10:39:22.509 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 534614030 0 0) 0x7fc6240035c0 con 0x7fc6400cb810 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 >> v2:172.21.15.186:3300/0 conn(0x7fc6400c6650 msgr2=0x7fc6400c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 --2- 172.21.15.16:0/1482145552 >> v2:172.21.15.186:3300/0 conn(0x7fc6400c6650 0x7fc6400c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 >> v1:172.21.15.186:6789/0 conn(0x7fc64015aec0 legacy=0x7fc64015b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400cc4c0 con 0x7fc6400cb810 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fc6300016d0 con 0x7fc6400cb810 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 >> v1:172.21.15.16:6789/0 conn(0x7fc6400cb810 legacy=0x7fc6400cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 0x7fc624003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6240048a0 0x7fc624004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624005240 0x7fc62400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc64015f020 con 0x7fc624003a50 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc62400c190 con 0x7fc624005240 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc62400c390 con 0x7fc6240048a0 2024-04-25T10:39:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 0x7fc624003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63f400640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624005240 0x7fc62400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63e000640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6240048a0 0x7fc624004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 -- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6240048a0 msgr2=0x7fc624004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6240048a0 0x7fc624004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 -- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624005240 msgr2=0x7fc62400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624005240 0x7fc62400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63ea00640 1 -- 172.21.15.16:0/1482145552 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6240035c0 con 0x7fc624003a50 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63f400640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624005240 0x7fc62400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.503+0000 7fc63f400640 1 -- 172.21.15.16:0/1482145552 reap_dead start 2024-04-25T10:39:22.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 0x7fc624003e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e1c0 tx=0x7fc63801cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928feb78831b1c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6380b2070 con 0x7fc624003a50 2024-04-25T10:39:22.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6380a5df0 con 0x7fc624003a50 2024-04-25T10:39:22.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63d600640 1 -- 172.21.15.16:0/1482145552 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638009cd0 con 0x7fc624003a50 2024-04-25T10:39:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 -- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 msgr2=0x7fc624003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 0x7fc624003e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc63800e1c0 tx=0x7fc63801cd20 comp rx=0 tx=0).stop 2024-04-25T10:39:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 -- 172.21.15.16:0/1482145552 shutdown_connections 2024-04-25T10:39:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1482145552 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc624003a50 0x7fc624003e80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.513 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 -- 172.21.15.16:0/1482145552 >> 172.21.15.16:0/1482145552 conn(0x7fc640072fa0 msgr2=0x7fc6400733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:22.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 -- 172.21.15.16:0/1482145552 shutdown_connections 2024-04-25T10:39:22.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.507+0000 7fc63fe00640 1 -- 172.21.15.16:0/1482145552 wait complete. 2024-04-25T10:39:22.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 Processor -- start 2024-04-25T10:39:22.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 -- start start 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624003a50 0x7fc6401583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc640157060 0x7fc64014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc64015ecb0 con 0x7fc6400b3f60 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc64015e9d0 con 0x7fc624003a50 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63fe00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc6400c74c0 con 0x7fc640157060 2024-04-25T10:39:22.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63e000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55212/0 (socket says 172.21.15.16:55212) 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63e000640 1 -- 172.21.15.16:0/1820389101 learned_addr learned my addr 172.21.15.16:0/1820389101 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.511+0000 7fc63f400640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc640157060 0x7fc64014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624003a50 0x7fc6401583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 -- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc640157060 msgr2=0x7fc64014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc640157060 0x7fc64014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 -- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624003a50 msgr2=0x7fc6401583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624003a50 0x7fc6401583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 -- 172.21.15.16:0/1820389101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc640157ee0 con 0x7fc6400b3f60 2024-04-25T10:39:22.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63e000640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e480 tx=0x7fc62800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628019070 con 0x7fc6400b3f60 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6280052e0 con 0x7fc6400b3f60 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628003820 con 0x7fc6400b3f60 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc640155830 con 0x7fc6400b3f60 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc640155af0 con 0x7fc6400b3f60 2024-04-25T10:39:22.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64006f1c0 con 0x7fc6400b3f60 2024-04-25T10:39:22.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.515+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc62801c070 con 0x7fc6400b3f60 2024-04-25T10:39:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.519+0000 7fc636a00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 0x7fc618071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.519+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc62808eb50 con 0x7fc6400b3f60 2024-04-25T10:39:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.519+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 0x7fc618071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.523 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.519+0000 7fc63ea00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 0x7fc618071ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6380af000 tx=0x7fc638004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.523+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc62805b0c0 con 0x7fc6400b3f60 2024-04-25T10:39:22.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.723+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc64014ee20 con 0x7fc6400b3f60 2024-04-25T10:39:22.759 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc636a00640 1 -- 172.21.15.16:0/1820389101 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fc62805f3c0 con 0x7fc6400b3f60 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 msgr2=0x7fc618071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 0x7fc618071ae0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc6380af000 tx=0x7fc638004ac0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 msgr2=0x7fc6401579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc62800e480 tx=0x7fc62800e880 comp rx=0 tx=0).stop 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 shutdown_connections 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc61806f5d0 0x7fc618071ae0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc640157060 0x7fc64014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6400b3f60 0x7fc6401579a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 --2- 172.21.15.16:0/1820389101 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc624003a50 0x7fc6401583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 >> 172.21.15.16:0/1820389101 conn(0x7fc640072fa0 msgr2=0x7fc640158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 shutdown_connections 2024-04-25T10:39:22.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.755+0000 7fc63fe00640 1 -- 172.21.15.16:0/1820389101 wait complete. 2024-04-25T10:39:22.783 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-04-25T10:39:22.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-25T10:39:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 Processor -- start 2024-04-25T10:39:22.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 -- start start 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5ea00cc1c0 0x7f5ea00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5ea0165c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea015e8b0 con 0x7f5ea00c67e0 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea015f430 con 0x7f5ea00cc1c0 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea7200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea015eb90 con 0x7f5ea0163800 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5ea00c67e0 0x7f5ea015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60764/0 (socket says 172.21.15.16:60764) 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9fe00640 1 -- 172.21.15.16:0/3073978771 learned_addr learned my addr 172.21.15.16:0/3073978771 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9f400640 1 --2- 172.21.15.16:0/3073978771 >> v2:172.21.15.186:3300/0 conn(0x7f5ea00cc1c0 0x7f5ea00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5ea5200640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5ea0165c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307557341 0 0) 0x7f5ea015e8b0 con 0x7f5ea00c67e0 2024-04-25T10:39:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e840035c0 con 0x7f5ea00c67e0 2024-04-25T10:39:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 614092001 0 0) 0x7f5e840035c0 con 0x7f5ea00c67e0 2024-04-25T10:39:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 msgr2=0x7f5ea0165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.935+0000 7f5e9ea00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5ea0165c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 >> v2:172.21.15.186:3300/0 conn(0x7f5ea00cc1c0 msgr2=0x7f5ea00cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 --2- 172.21.15.16:0/3073978771 >> v2:172.21.15.186:3300/0 conn(0x7f5ea00cc1c0 0x7f5ea00cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea015ee70 con 0x7f5ea00c67e0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f5e900016d0 con 0x7f5ea00c67e0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 >> v1:172.21.15.16:6789/0 conn(0x7f5ea00c67e0 legacy=0x7f5ea015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84003a50 0x7f5e84003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5e840048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e84004de0 0x7f5e840051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea015f430 con 0x7f5e84003a50 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea015eb90 con 0x7f5e84004de0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5e8400bae0 con 0x7f5ea0163800 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84003a50 0x7f5e84003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9f400640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5e840048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5ea5200640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e84004de0 0x7f5e840051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 -- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 msgr2=0x7f5e840048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea0163800 0x7f5e840048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 -- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e84004de0 msgr2=0x7f5e840051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5e84004de0 0x7f5e840051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 -- 172.21.15.16:0/3073978771 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840035c0 con 0x7f5e84003a50 2024-04-25T10:39:22.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84003a50 0x7f5e84003ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c2f0 tx=0x7f5e9001f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07efbdd9f9a7c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90007e20 con 0x7f5e84003a50 2024-04-25T10:39:22.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90005b40 con 0x7f5e84003a50 2024-04-25T10:39:22.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.939+0000 7f5e9ea00640 1 -- 172.21.15.16:0/3073978771 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90007070 con 0x7f5e84003a50 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- 172.21.15.16:0/3073978771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84003a50 msgr2=0x7f5e84003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 --2- 172.21.15.16:0/3073978771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e84003a50 0x7f5e84003ec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000c2f0 tx=0x7f5e9001f4b0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea5200640 1 -- 172.21.15.16:0/3073978771 reap_dead start 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- 172.21.15.16:0/3073978771 shutdown_connections 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- 172.21.15.16:0/3073978771 >> 172.21.15.16:0/3073978771 conn(0x7f5ea00732e0 msgr2=0x7f5ea00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- 172.21.15.16:0/3073978771 shutdown_connections 2024-04-25T10:39:22.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- 172.21.15.16:0/3073978771 wait complete. 2024-04-25T10:39:22.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 Processor -- start 2024-04-25T10:39:22.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.943+0000 7f5ea7200640 1 -- start start 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ea006de80 0x7f5ea0150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea01ebfe0 0x7f5ea01ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea015bdb0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea015b180 con 0x7f5ea006de80 2024-04-25T10:39:22.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea015bf30 con 0x7f5ea01ebfe0 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55240/0 (socket says 172.21.15.16:55240) 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 -- 172.21.15.16:0/843767827 learned_addr learned my addr 172.21.15.16:0/843767827 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ea006de80 0x7f5ea0150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5e9f400640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea01ebfe0 0x7f5ea01ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 -- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea01ebfe0 msgr2=0x7f5ea01ec3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea01ebfe0 0x7f5ea01ec3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 -- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ea006de80 msgr2=0x7f5ea0150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ea006de80 0x7f5ea0150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:22.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 -- 172.21.15.16:0/843767827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea006edb0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea5200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00744a0 tx=0x7f5e980115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e980039a0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9801b070 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98003be0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea006eb10 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea01f96b0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.947+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea006f1c0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.951+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e98004030 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.951+0000 7f5e97e00640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 0x7f5e78071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:22.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.951+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5e9808feb0 con 0x7f5ea01fbdb0 2024-04-25T10:39:22.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.951+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 0x7f5e78071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:22.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.951+0000 7f5e9fe00640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 0x7f5e78071ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e900ae000 tx=0x7f5e90007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:22.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:22.955+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e98025020 con 0x7f5ea01fbdb0 2024-04-25T10:39:23.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.159+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f5ea01505b0 con 0x7f5ea01fbdb0 2024-04-25T10:39:23.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5e97e00640 1 -- 172.21.15.16:0/843767827 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f5e9805c3c0 con 0x7f5ea01fbdb0 2024-04-25T10:39:23.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 msgr2=0x7f5e78071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 0x7f5e78071ae0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e900ae000 tx=0x7f5e90007040 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 msgr2=0x7f5ea01fc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00744a0 tx=0x7f5e980115a0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 shutdown_connections 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5e7806f5d0 0x7f5e78071ae0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ea01fbdb0 0x7f5ea01fc1c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ea01ebfe0 0x7f5ea01ec3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 --2- 172.21.15.16:0/843767827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ea006de80 0x7f5ea0150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 >> 172.21.15.16:0/843767827 conn(0x7f5ea00732e0 msgr2=0x7f5ea015a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 shutdown_connections 2024-04-25T10:39:23.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.775+0000 7f5ea7200640 1 -- 172.21.15.16:0/843767827 wait complete. 2024-04-25T10:39:23.811 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:39:23.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 Processor -- start 2024-04-25T10:39:23.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 -- start start 2024-04-25T10:39:23.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb601552b0 0x7ffb600c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c93f0 0x7ffb600c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb600cb560 con 0x7ffb600c78e0 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffb600c51e0 con 0x7ffb601552b0 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb66600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600c2470 con 0x7ffb600c93f0 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb5f400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffb601552b0 0x7ffb600c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb5fe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffb600c78e0 0x7ffb6006c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:60780/0 (socket says 172.21.15.16:60780) 2024-04-25T10:39:23.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.963+0000 7ffb5fe00640 1 -- 172.21.15.16:0/3757511431 learned_addr learned my addr 172.21.15.16:0/3757511431 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb57e00640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c93f0 0x7ffb600c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5f400640 1 -- 172.21.15.16:0/3757511431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c93f0 msgr2=0x7ffb600c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5f400640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c93f0 0x7ffb600c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5f400640 1 -- 172.21.15.16:0/3757511431 >> v1:172.21.15.16:6789/0 conn(0x7ffb600c78e0 legacy=0x7ffb6006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5f400640 1 -- 172.21.15.16:0/3757511431 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb600ca6a0 con 0x7ffb601552b0 2024-04-25T10:39:23.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5ea00640 1 -- 172.21.15.16:0/3757511431 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639223086 0 0) 0x7ffb600cb560 con 0x7ffb600c78e0 2024-04-25T10:39:23.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5f400640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb600c4ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009900 tx=0x7ffb5001c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985d7acbe0de8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:23.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5ea00640 1 -- 172.21.15.16:0/3757511431 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500aa5f0 con 0x7ffb601552b0 2024-04-25T10:39:23.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5ea00640 1 -- 172.21.15.16:0/3757511431 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb500af070 con 0x7ffb601552b0 2024-04-25T10:39:23.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.967+0000 7ffb5ea00640 1 -- 172.21.15.16:0/3757511431 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500aa9b0 con 0x7ffb601552b0 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- 172.21.15.16:0/3757511431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 msgr2=0x7ffb600c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb600c4ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009900 tx=0x7ffb5001c5a0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- 172.21.15.16:0/3757511431 shutdown_connections 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c93f0 0x7ffb600c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 --2- 172.21.15.16:0/3757511431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb600c4ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- 172.21.15.16:0/3757511431 >> 172.21.15.16:0/3757511431 conn(0x7ffb6006dd80 msgr2=0x7ffb60072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:23.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- 172.21.15.16:0/3757511431 shutdown_connections 2024-04-25T10:39:23.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- 172.21.15.16:0/3757511431 wait complete. 2024-04-25T10:39:23.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 Processor -- start 2024-04-25T10:39:23.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.971+0000 7ffb66600640 1 -- start start 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c78e0 0x7ffb600b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb600c93f0 0x7ffb600b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffb601556c0 con 0x7ffb601552b0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ffb600c1f50 con 0x7ffb600c93f0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffb600c8100 con 0x7ffb600c78e0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55268/0 (socket says 172.21.15.16:55268) 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 -- 172.21.15.16:0/296772642 learned_addr learned my addr 172.21.15.16:0/296772642 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5f400640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c78e0 0x7ffb600b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb57e00640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb600c93f0 0x7ffb600b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 -- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c78e0 msgr2=0x7ffb600b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c78e0 0x7ffb600b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 -- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb600c93f0 msgr2=0x7ffb600b8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb600c93f0 0x7ffb600b8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 -- 172.21.15.16:0/296772642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb600bbdb0 con 0x7ffb601552b0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb5fe00640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c810 tx=0x7ffb5800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58018070 con 0x7ffb601552b0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5800a640 con 0x7ffb601552b0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb601571b0 con 0x7ffb601552b0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800aa30 con 0x7ffb601552b0 2024-04-25T10:39:23.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb60157770 con 0x7ffb601552b0 2024-04-25T10:39:23.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.975+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb600bbb20 con 0x7ffb601552b0 2024-04-25T10:39:23.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.979+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb5801b070 con 0x7ffb601552b0 2024-04-25T10:39:23.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.979+0000 7ffb57400640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 0x7ffb38071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:23.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.979+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffb5808ecc0 con 0x7ffb601552b0 2024-04-25T10:39:23.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.979+0000 7ffb5f400640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 0x7ffb38071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:23.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.979+0000 7ffb5f400640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 0x7ffb38071ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb500ae000 tx=0x7ffb500a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:23.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:23.983+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb58095080 con 0x7ffb601552b0 2024-04-25T10:39:24.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.183+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffb6006f0a0 con 0x7ffb601552b0 2024-04-25T10:39:24.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.783+0000 7ffb57400640 1 -- 172.21.15.16:0/296772642 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7ffb5805b820 con 0x7ffb601552b0 2024-04-25T10:39:24.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 msgr2=0x7ffb38071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 0x7ffb38071ab0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffb500ae000 tx=0x7ffb500a7000 comp rx=0 tx=0).stop 2024-04-25T10:39:24.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 msgr2=0x7ffb6015a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c810 tx=0x7ffb5800ccd0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 shutdown_connections 2024-04-25T10:39:24.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffb3806f5a0 0x7ffb38071ab0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb601552b0 0x7ffb6015a2e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb600c93f0 0x7ffb600b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 --2- 172.21.15.16:0/296772642 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb600c78e0 0x7ffb600b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 >> 172.21.15.16:0/296772642 conn(0x7ffb6006dd80 msgr2=0x7ffb600cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:24.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 shutdown_connections 2024-04-25T10:39:24.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.787+0000 7ffb66600640 1 -- 172.21.15.16:0/296772642 wait complete. 2024-04-25T10:39:24.821 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T10:39:24.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 Processor -- start 2024-04-25T10:39:24.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 -- start start 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87e81552b0 0x7f87e80c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e81658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e80cb560 con 0x7f87e80c93f0 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f87e80c51e0 con 0x7f87e81552b0 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87ee200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f87e80c2470 con 0x7f87e80c9800 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87e81552b0 0x7f87e80c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87dfe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87e80c93f0 0x7f87e80c78e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38396/0 (socket says 172.21.15.16:38396) 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87dfe00640 1 -- 172.21.15.16:0/3255030582 learned_addr learned my addr 172.21.15.16:0/3255030582 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:24.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7e00640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e81658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7400640 1 -- 172.21.15.16:0/3255030582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 msgr2=0x7f87e81658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7400640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e81658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7400640 1 -- 172.21.15.16:0/3255030582 >> v1:172.21.15.16:6789/0 conn(0x7f87e80c93f0 legacy=0x7f87e80c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7400640 1 -- 172.21.15.16:0/3255030582 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e80ca6a0 con 0x7f87e81552b0 2024-04-25T10:39:24.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.975+0000 7f87e7e00640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e81658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:24.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87e7400640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e80c4ca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009900 tx=0x7f87d801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931dfd68df842a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:24.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87e6a00640 1 -- 172.21.15.16:0/3255030582 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a9660 con 0x7f87e81552b0 2024-04-25T10:39:24.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87e6a00640 1 -- 172.21.15.16:0/3255030582 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d80a9800 con 0x7f87e81552b0 2024-04-25T10:39:24.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87e6a00640 1 -- 172.21.15.16:0/3255030582 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a9c10 con 0x7f87e81552b0 2024-04-25T10:39:24.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 -- 172.21.15.16:0/3255030582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 msgr2=0x7f87e80c4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e80c4ca0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009900 tx=0x7f87d801c5a0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 -- 172.21.15.16:0/3255030582 shutdown_connections 2024-04-25T10:39:24.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e81658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 --2- 172.21.15.16:0/3255030582 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e80c4ca0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 -- 172.21.15.16:0/3255030582 >> 172.21.15.16:0/3255030582 conn(0x7f87e806dd80 msgr2=0x7f87e8072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:24.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 -- 172.21.15.16:0/3255030582 shutdown_connections 2024-04-25T10:39:24.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.979+0000 7f87ee200640 1 -- 172.21.15.16:0/3255030582 wait complete. 2024-04-25T10:39:24.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 Processor -- start 2024-04-25T10:39:24.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 -- start start 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e80c93f0 0x7f87e81faf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e8156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81556c0 con 0x7f87e81552b0 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87e80c1f50 con 0x7f87e80c93f0 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87ee200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f87e80c9c10 con 0x7f87e80c9800 2024-04-25T10:39:24.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46532/0 (socket says 172.21.15.16:46532) 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87e7e00640 1 -- 172.21.15.16:0/2958286010 learned_addr learned my addr 172.21.15.16:0/2958286010 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87e7400640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e80c93f0 0x7f87e81faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.983+0000 7f87dfe00640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 -- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 msgr2=0x7f87e8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 -- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e80c93f0 msgr2=0x7f87e81faf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e80c93f0 0x7f87e81faf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 -- 172.21.15.16:0/2958286010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e8156ed0 con 0x7f87e81552b0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87dfe00640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87e7e00640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f87e0007ee0 tx=0x7f87e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e001a070 con 0x7f87e81552b0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e0015600 con 0x7f87e81552b0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e00159b0 con 0x7f87e81552b0 2024-04-25T10:39:24.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e8156cc0 con 0x7f87e81552b0 2024-04-25T10:39:24.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e81fb8c0 con 0x7f87e81552b0 2024-04-25T10:39:24.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e81fb650 con 0x7f87e81552b0 2024-04-25T10:39:24.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.987+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87e001d070 con 0x7f87e81552b0 2024-04-25T10:39:24.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.991+0000 7f87df400640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 0x7f87c0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:24.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.991+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f87e008f910 con 0x7f87e81552b0 2024-04-25T10:39:24.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.991+0000 7f87e7400640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 0x7f87c0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:24.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.991+0000 7f87e7400640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 0x7f87c0071ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ae000 tx=0x7f87d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:24.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:24.995+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87e8156ed0 con 0x7f87e81552b0 2024-04-25T10:39:25.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.195+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f87e81fbc60 con 0x7f87e81552b0 2024-04-25T10:39:25.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.795+0000 7f87df400640 1 -- 172.21.15.16:0/2958286010 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) ==== 115+0+0 (secure 0 0 0) 0x7f87e0010070 con 0x7f87e81552b0 2024-04-25T10:39:25.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 msgr2=0x7f87c0071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 0x7f87c0071ae0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87d80ae000 tx=0x7f87d8009040 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 msgr2=0x7f87e814e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f87e0007ee0 tx=0x7f87e000d4a0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 shutdown_connections 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f87c006f5d0 0x7f87c0071ae0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87e81552b0 0x7f87e814e910 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f87e80c9800 0x7f87e8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 --2- 172.21.15.16:0/2958286010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f87e80c93f0 0x7f87e81faf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 >> 172.21.15.16:0/2958286010 conn(0x7f87e806dd80 msgr2=0x7f87e80bf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 shutdown_connections 2024-04-25T10:39:25.805 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.799+0000 7f87ee200640 1 -- 172.21.15.16:0/2958286010 wait complete. 2024-04-25T10:39:25.825 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:39:25.826 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:25.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.975+0000 7f1089600640 1 Processor -- start 2024-04-25T10:39:25.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.975+0000 7f1089600640 1 -- start start 2024-04-25T10:39:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1089600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1084155100 0x7f10840ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1089600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10840ca660 0x7f10841657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1089600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108415e5f0 con 0x7f108415b960 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1089600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f108415e890 con 0x7f10840ca660 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1089600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f108415eb70 con 0x7f1084155100 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10840ca660 0x7f10841657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10840ca660 0x7f10841657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46540/0 (socket says 172.21.15.16:46540) 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 -- 172.21.15.16:0/1358518774 learned_addr learned my addr 172.21.15.16:0/1358518774 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:25.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f107a000640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1084155100 0x7f10840ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 -- 172.21.15.16:0/1358518774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1084155100 msgr2=0x7f10840ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1084155100 0x7f10840ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 -- 172.21.15.16:0/1358518774 >> v1:172.21.15.186:6789/0 conn(0x7f108415b960 legacy=0x7f10840c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.979+0000 7f1083400640 1 -- 172.21.15.16:0/1358518774 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108415ee50 con 0x7f10840ca660 2024-04-25T10:39:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1083400640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10840ca660 0x7f10841657a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f107c009fa0 tx=0x7f107c01cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980580e4428e9708 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1082000640 1 -- 172.21.15.16:0/1358518774 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c0a58d0 con 0x7f10840ca660 2024-04-25T10:39:25.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1082000640 1 -- 172.21.15.16:0/1358518774 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0a5a70 con 0x7f10840ca660 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1082000640 1 -- 172.21.15.16:0/1358518774 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c007430 con 0x7f10840ca660 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- 172.21.15.16:0/1358518774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10840ca660 msgr2=0x7f10841657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10840ca660 0x7f10841657a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f107c009fa0 tx=0x7f107c01cb30 comp rx=0 tx=0).stop 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- 172.21.15.16:0/1358518774 shutdown_connections 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10840ca660 0x7f10841657a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 --2- 172.21.15.16:0/1358518774 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1084155100 0x7f10840ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- 172.21.15.16:0/1358518774 >> 172.21.15.16:0/1358518774 conn(0x7f1084073180 msgr2=0x7f1084073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- 172.21.15.16:0/1358518774 shutdown_connections 2024-04-25T10:39:25.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- 172.21.15.16:0/1358518774 wait complete. 2024-04-25T10:39:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 Processor -- start 2024-04-25T10:39:25.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.983+0000 7f1089600640 1 -- start start 2024-04-25T10:39:25.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10840ca660 0x7f1084149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1084155100 0x7f1084156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10840c9180 con 0x7f108415b960 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1084155510 con 0x7f1084155100 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f10840c9300 con 0x7f10840ca660 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46552/0 (socket says 172.21.15.16:46552) 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 -- 172.21.15.16:0/1389495532 learned_addr learned my addr 172.21.15.16:0/1389495532 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1082a00640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10840ca660 0x7f1084149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f107a000640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1084155100 0x7f1084156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 -- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10840ca660 msgr2=0x7f1084149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10840ca660 0x7f1084149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 -- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1084155100 msgr2=0x7f1084156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1084155100 0x7f1084156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 -- 172.21.15.16:0/1389495532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1084156780 con 0x7f108415b960 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1083400640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f107c0af040 tx=0x7f107c0198d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c0a58d0 con 0x7f108415b960 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0be070 con 0x7f108415b960 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1084152bf0 con 0x7f108415b960 2024-04-25T10:39:25.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c009550 con 0x7f108415b960 2024-04-25T10:39:25.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10841531b0 con 0x7f108415b960 2024-04-25T10:39:25.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.987+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1084050750 con 0x7f108415b960 2024-04-25T10:39:25.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.991+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f107c0b86f0 con 0x7f108415b960 2024-04-25T10:39:25.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.991+0000 7f107b400640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 0x7f105c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:25.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.991+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f107c12abb0 con 0x7f108415b960 2024-04-25T10:39:25.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.991+0000 7f1082a00640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 0x7f105c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:25.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.991+0000 7f1082a00640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 0x7f105c071ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1074007fd0 tx=0x7f1074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:25.995+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f107c016720 con 0x7f108415b960 2024-04-25T10:39:26.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.195+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10840c81c0 con 0x7f108415b960 2024-04-25T10:39:26.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.195+0000 7f107b400640 1 -- 172.21.15.16:0/1389495532 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7f107c0f70c0 con 0x7f108415b960 2024-04-25T10:39:26.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:26.201 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T10:39:26.201 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 msgr2=0x7f105c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 0x7f105c071ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1074007fd0 tx=0x7f1074009040 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 msgr2=0x7f108414ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f107c0af040 tx=0x7f107c0198d0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 shutdown_connections 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f105c06f5a0 0x7f105c071ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f108415b960 0x7f108414ba40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1084155100 0x7f1084156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 --2- 172.21.15.16:0/1389495532 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10840ca660 0x7f1084149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 >> 172.21.15.16:0/1389495532 conn(0x7f1084073180 msgr2=0x7f10841597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:26.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 shutdown_connections 2024-04-25T10:39:26.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.199+0000 7f1089600640 1 -- 172.21.15.16:0/1389495532 wait complete. 2024-04-25T10:39:26.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:26.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 Processor -- start 2024-04-25T10:39:26.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 -- start start 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f37e80c67c0 0x7f37e8157340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37e815dd00 0x7f37e80c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e8160b50 con 0x7f37e815d8f0 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f37e81616d0 con 0x7f37e815dd00 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.371+0000 7f37efa00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f37e80c9810 con 0x7f37e80c67c0 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37e815dd00 0x7f37e80c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f37e815dd00 0x7f37e80c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46568/0 (socket says 172.21.15.16:46568) 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37ed000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f37e80c67c0 0x7f37e8157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 -- 172.21.15.16:0/3803269560 learned_addr learned my addr 172.21.15.16:0/3803269560 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:26.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37dfe00640 1 --1- 172.21.15.16:0/3803269560 >> v1:172.21.15.186:6789/0 conn(0x7f37e815d8f0 0x7f37e80c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45226/0 (socket says 172.21.15.16:45226) 2024-04-25T10:39:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 -- 172.21.15.16:0/3803269560 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c67c0 msgr2=0x7f37e8157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 --2- 172.21.15.16:0/3803269560 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c67c0 0x7f37e8157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 -- 172.21.15.16:0/3803269560 >> v1:172.21.15.186:6789/0 conn(0x7f37e815d8f0 legacy=0x7f37e80c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 -- 172.21.15.16:0/3803269560 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e8160e30 con 0x7f37e815dd00 2024-04-25T10:39:26.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37eda00640 1 --2- 172.21.15.16:0/3803269560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c92d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cc930 tx=0x7f37e001cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a993518b6752aff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37e7e00640 1 -- 172.21.15.16:0/3803269560 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a5990 con 0x7f37e815dd00 2024-04-25T10:39:26.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37e7e00640 1 -- 172.21.15.16:0/3803269560 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e00a5b30 con 0x7f37e815dd00 2024-04-25T10:39:26.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.375+0000 7f37e7e00640 1 -- 172.21.15.16:0/3803269560 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0007430 con 0x7f37e815dd00 2024-04-25T10:39:26.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- 172.21.15.16:0/3803269560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 msgr2=0x7f37e80c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 --2- 172.21.15.16:0/3803269560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c92d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cc930 tx=0x7f37e001cac0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- 172.21.15.16:0/3803269560 shutdown_connections 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 --2- 172.21.15.16:0/3803269560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c92d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 --2- 172.21.15.16:0/3803269560 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c67c0 0x7f37e8157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- 172.21.15.16:0/3803269560 >> 172.21.15.16:0/3803269560 conn(0x7f37e8073180 msgr2=0x7f37e8073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- 172.21.15.16:0/3803269560 shutdown_connections 2024-04-25T10:39:26.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- 172.21.15.16:0/3803269560 wait complete. 2024-04-25T10:39:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 Processor -- start 2024-04-25T10:39:26.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.379+0000 7f37efa00640 1 -- start start 2024-04-25T10:39:26.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80c67c0 0x7f37e80c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e815d8f0 0x7f37e80c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8157880 con 0x7f37e815dd00 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37e815e110 con 0x7f37e80c67c0 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f37e8157a00 con 0x7f37e815d8f0 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46570/0 (socket says 172.21.15.16:46570) 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 -- 172.21.15.16:0/24795474 learned_addr learned my addr 172.21.15.16:0/24795474 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37ed000640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80c67c0 0x7f37e80c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37dfe00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e815d8f0 0x7f37e80c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 -- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e815d8f0 msgr2=0x7f37e80c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e815d8f0 0x7f37e80c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 -- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80c67c0 msgr2=0x7f37e80c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80c67c0 0x7f37e80c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 -- 172.21.15.16:0/24795474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e80c5c80 con 0x7f37e815dd00 2024-04-25T10:39:26.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37eda00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37e001c530 tx=0x7f37e0019860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a5990 con 0x7f37e815dd00 2024-04-25T10:39:26.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e00be070 con 0x7f37e815dd00 2024-04-25T10:39:26.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e80c3550 con 0x7f37e815dd00 2024-04-25T10:39:26.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0009550 con 0x7f37e815dd00 2024-04-25T10:39:26.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e81ff2e0 con 0x7f37e815dd00 2024-04-25T10:39:26.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.383+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e80c32c0 con 0x7f37e815dd00 2024-04-25T10:39:26.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.387+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f37e00b8770 con 0x7f37e815dd00 2024-04-25T10:39:26.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.387+0000 7f37e5600640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 0x7f37c0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.387+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f37e012ab30 con 0x7f37e815dd00 2024-04-25T10:39:26.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.387+0000 7f37ed000640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 0x7f37c0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.387+0000 7f37ed000640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 0x7f37c0071ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cb5c0 tx=0x7f37d80091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.391+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37e00166e0 con 0x7f37e815dd00 2024-04-25T10:39:26.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.559+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37e8000920 con 0x7f37e815dd00 2024-04-25T10:39:26.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.559+0000 7f37e5600640 1 -- 172.21.15.16:0/24795474 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f37e00f7040 con 0x7f37e815dd00 2024-04-25T10:39:26.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:26.565 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 msgr2=0x7f37c0071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 0x7f37c0071ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cb5c0 tx=0x7f37d80091c0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 msgr2=0x7f37e80c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37e001c530 tx=0x7f37e0019860 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 shutdown_connections 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5d0 0x7f37c0071ae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e815dd00 0x7f37e80c4320 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e815d8f0 0x7f37e80c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 --2- 172.21.15.16:0/24795474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80c67c0 0x7f37e80c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 >> 172.21.15.16:0/24795474 conn(0x7f37e8073180 msgr2=0x7f37e815c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 shutdown_connections 2024-04-25T10:39:26.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.563+0000 7f37efa00640 1 -- 172.21.15.16:0/24795474 wait complete. 2024-04-25T10:39:26.588 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:39:26.589 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:39:26.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.735+0000 7f538ce00640 1 Processor -- start 2024-04-25T10:39:26.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.735+0000 7f538ce00640 1 -- start start 2024-04-25T10:39:26.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f538ce00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f538815b960 0x7f5388155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f538ce00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53880ca830 0x7f53880c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f538ce00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538815e5f0 con 0x7f53880c8a70 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f538ce00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5388155640 con 0x7f53880ca830 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f538ce00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f538815e890 con 0x7f538815b960 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53880ca830 0x7f53880c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f53880ca830 0x7f53880c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46586/0 (socket says 172.21.15.16:46586) 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 -- 172.21.15.16:0/1408791387 learned_addr learned my addr 172.21.15.16:0/1408791387 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5385e00640 1 --2- 172.21.15.16:0/1408791387 >> v2:172.21.15.186:3300/0 conn(0x7f538815b960 0x7f5388155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 -- 172.21.15.16:0/1408791387 >> v2:172.21.15.186:3300/0 conn(0x7f538815b960 msgr2=0x7f5388155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 --2- 172.21.15.16:0/1408791387 >> v2:172.21.15.186:3300/0 conn(0x7f538815b960 0x7f5388155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 -- 172.21.15.16:0/1408791387 >> v1:172.21.15.186:6789/0 conn(0x7f53880c8a70 legacy=0x7f53880ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.739+0000 7f5386800640 1 -- 172.21.15.16:0/1408791387 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538815eb70 con 0x7f53880ca830 2024-04-25T10:39:26.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f5386800640 1 --2- 172.21.15.16:0/1408791387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880ca830 0x7f53880c8e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f53880ccd00 tx=0x7f538001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94023869ebbc95c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f5385400640 1 -- 172.21.15.16:0/1408791387 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800a57c0 con 0x7f53880ca830 2024-04-25T10:39:26.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f5385400640 1 -- 172.21.15.16:0/1408791387 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53800a5960 con 0x7f53880ca830 2024-04-25T10:39:26.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f5385400640 1 -- 172.21.15.16:0/1408791387 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800a5d70 con 0x7f53880ca830 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 -- 172.21.15.16:0/1408791387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880ca830 msgr2=0x7f53880c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 --2- 172.21.15.16:0/1408791387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880ca830 0x7f53880c8e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f53880ccd00 tx=0x7f538001caf0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 -- 172.21.15.16:0/1408791387 shutdown_connections 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 --2- 172.21.15.16:0/1408791387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880ca830 0x7f53880c8e80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 --2- 172.21.15.16:0/1408791387 >> v2:172.21.15.186:3300/0 conn(0x7f538815b960 0x7f5388155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 -- 172.21.15.16:0/1408791387 >> 172.21.15.16:0/1408791387 conn(0x7f5388073180 msgr2=0x7f5388073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 -- 172.21.15.16:0/1408791387 shutdown_connections 2024-04-25T10:39:26.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.743+0000 7f538ce00640 1 -- 172.21.15.16:0/1408791387 wait complete. 2024-04-25T10:39:26.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 Processor -- start 2024-04-25T10:39:26.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- start start 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 0x7f538806e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f538815b960 0x7f53881ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c97d0 con 0x7f53880c8a70 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f53880c9650 con 0x7f53880ca830 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5388167fc0 con 0x7f538815b960 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46594/0 (socket says 172.21.15.16:46594) 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 -- 172.21.15.16:0/1219908584 learned_addr learned my addr 172.21.15.16:0/1219908584 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:26.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f537fe00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 0x7f538806e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5386800640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f538815b960 0x7f53881ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 -- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f538815b960 msgr2=0x7f53881ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f538815b960 0x7f53881ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 -- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 msgr2=0x7f538806e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 0x7f538806e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 -- 172.21.15.16:0/1219908584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5388150bb0 con 0x7f53880c8a70 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f537fe00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 0x7f538806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f5385e00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f537800e9e0 tx=0x7f537800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378017070 con 0x7f53880c8a70 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537800c9d0 con 0x7f53880c8a70 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53881efda0 con 0x7f53880c8a70 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537800cd80 con 0x7f53880c8a70 2024-04-25T10:39:26.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.747+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53881feb30 con 0x7f53880c8a70 2024-04-25T10:39:26.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5388050750 con 0x7f53880c8a70 2024-04-25T10:39:26.755 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f537801a070 con 0x7f53880c8a70 2024-04-25T10:39:26.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f537e000640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 0x7f5360071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:26.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f537808f7a0 con 0x7f53880c8a70 2024-04-25T10:39:26.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f537fe00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 0x7f5360071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:26.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.751+0000 7f537fe00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 0x7f5360071ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53881fc550 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:26.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.755+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f537805c270 con 0x7f53880c8a70 2024-04-25T10:39:26.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.923+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f538814cc00 con 0x7f536006f5a0 2024-04-25T10:39:26.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.947+0000 7f537e000640 1 -- 172.21.15.16:0/1219908584 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332776 (secure 0 0 0) 0x7f538814cc00 con 0x7f536006f5a0 2024-04-25T10:39:26.959 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:26.962 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T10:39:26.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 msgr2=0x7f5360071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 0x7f5360071ab0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53881fc550 tx=0x7f5370009040 comp rx=0 tx=0).stop 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 msgr2=0x7f538806e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f537800e9e0 tx=0x7f537800eea0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 shutdown_connections 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f536006f5a0 0x7f5360071ab0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f538815b960 0x7f53881ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53880ca830 0x7f538806e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 --2- 172.21.15.16:0/1219908584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53880c8a70 0x7f538806e200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 >> 172.21.15.16:0/1219908584 conn(0x7f5388073180 msgr2=0x7f5388163920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 shutdown_connections 2024-04-25T10:39:26.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:26.955+0000 7f538ce00640 1 -- 172.21.15.16:0/1219908584 wait complete. 2024-04-25T10:39:26.979 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T10:39:25.664753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":229,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231024,"kb_used_data":2416,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743696,"statfs":{"total":773094113280,"available":772857544704,"internally_reserved":0,"allocated":2473984,"data_stored":2089340,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4593,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006250"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812213+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T10:39:24.812213+0000","last_peered":"2024-04-25T10:39:24.812213+0000","last_clean":"2024-04-25T10:39:24.812213+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T10:39:24.812213+0000","last_undegraded":"2024-04-25T10:39:24.812213+0000","last_fullsized":"2024-04-25T10:39:24.812213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376558+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T10:39:05.376558+0000","last_peered":"2024-04-25T10:39:05.376558+0000","last_clean":"2024-04-25T10:39:05.376558+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T10:39:05.376558+0000","last_undegraded":"2024-04-25T10:39:05.376558+0000","last_fullsized":"2024-04-25T10:39:05.376558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375270+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T10:39:05.375270+0000","last_peered":"2024-04-25T10:39:05.375270+0000","last_clean":"2024-04-25T10:39:05.375270+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T10:39:05.375270+0000","last_undegraded":"2024-04-25T10:39:05.375270+0000","last_fullsized":"2024-04-25T10:39:05.375270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376755+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T10:39:05.376755+0000","last_peered":"2024-04-25T10:39:05.376755+0000","last_clean":"2024-04-25T10:39:05.376755+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T10:39:05.376755+0000","last_undegraded":"2024-04-25T10:39:05.376755+0000","last_fullsized":"2024-04-25T10:39:05.376755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371897+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T10:39:06.371897+0000","last_peered":"2024-04-25T10:39:06.371897+0000","last_clean":"2024-04-25T10:39:06.371897+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T10:39:06.371897+0000","last_undegraded":"2024-04-25T10:39:06.371897+0000","last_fullsized":"2024-04-25T10:39:06.371897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407381+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T10:39:06.407381+0000","last_peered":"2024-04-25T10:39:06.407381+0000","last_clean":"2024-04-25T10:39:06.407381+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T10:39:06.407381+0000","last_undegraded":"2024-04-25T10:39:06.407381+0000","last_fullsized":"2024-04-25T10:39:06.407381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812298+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T10:39:24.812298+0000","last_peered":"2024-04-25T10:39:24.812298+0000","last_clean":"2024-04-25T10:39:24.812298+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T10:39:24.812298+0000","last_undegraded":"2024-04-25T10:39:24.812298+0000","last_fullsized":"2024-04-25T10:39:24.812298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382480+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T10:39:05.382480+0000","last_peered":"2024-04-25T10:39:05.382480+0000","last_clean":"2024-04-25T10:39:05.382480+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T10:39:05.382480+0000","last_undegraded":"2024-04-25T10:39:05.382480+0000","last_fullsized":"2024-04-25T10:39:05.382480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408782+0000","last_change":"2024-04-25T10:39:03.421468+0000","last_active":"2024-04-25T10:39:06.408782+0000","last_peered":"2024-04-25T10:39:06.408782+0000","last_clean":"2024-04-25T10:39:06.408782+0000","last_became_active":"2024-04-25T10:39:03.417909+0000","last_became_peered":"2024-04-25T10:39:03.417909+0000","last_unstale":"2024-04-25T10:39:06.408782+0000","last_undegraded":"2024-04-25T10:39:06.408782+0000","last_fullsized":"2024-04-25T10:39:06.408782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:52.327065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261792+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T10:39:06.261792+0000","last_peered":"2024-04-25T10:39:06.261792+0000","last_clean":"2024-04-25T10:39:06.261792+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T10:39:06.261792+0000","last_undegraded":"2024-04-25T10:39:06.261792+0000","last_fullsized":"2024-04-25T10:39:06.261792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380874+0000","last_change":"2024-04-25T10:38:59.354375+0000","last_active":"2024-04-25T10:39:05.380874+0000","last_peered":"2024-04-25T10:39:05.380874+0000","last_clean":"2024-04-25T10:39:05.380874+0000","last_became_active":"2024-04-25T10:38:59.354038+0000","last_became_peered":"2024-04-25T10:38:59.354038+0000","last_unstale":"2024-04-25T10:39:05.380874+0000","last_undegraded":"2024-04-25T10:39:05.380874+0000","last_fullsized":"2024-04-25T10:39:05.380874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408576+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T10:39:06.408576+0000","last_peered":"2024-04-25T10:39:06.408576+0000","last_clean":"2024-04-25T10:39:06.408576+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T10:39:06.408576+0000","last_undegraded":"2024-04-25T10:39:06.408576+0000","last_fullsized":"2024-04-25T10:39:06.408576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382459+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T10:39:05.382459+0000","last_peered":"2024-04-25T10:39:05.382459+0000","last_clean":"2024-04-25T10:39:05.382459+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T10:39:05.382459+0000","last_undegraded":"2024-04-25T10:39:05.382459+0000","last_fullsized":"2024-04-25T10:39:05.382459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.809062+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T10:39:23.809062+0000","last_peered":"2024-04-25T10:39:23.809062+0000","last_clean":"2024-04-25T10:39:23.809062+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T10:39:23.809062+0000","last_undegraded":"2024-04-25T10:39:23.809062+0000","last_fullsized":"2024-04-25T10:39:23.809062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409380+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T10:39:06.409380+0000","last_peered":"2024-04-25T10:39:06.409380+0000","last_clean":"2024-04-25T10:39:06.409380+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T10:39:06.409380+0000","last_undegraded":"2024-04-25T10:39:06.409380+0000","last_fullsized":"2024-04-25T10:39:06.409380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376030+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T10:39:05.376030+0000","last_peered":"2024-04-25T10:39:05.376030+0000","last_clean":"2024-04-25T10:39:05.376030+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T10:39:05.376030+0000","last_undegraded":"2024-04-25T10:39:05.376030+0000","last_fullsized":"2024-04-25T10:39:05.376030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.449980+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T10:39:06.449980+0000","last_peered":"2024-04-25T10:39:06.449980+0000","last_clean":"2024-04-25T10:39:06.449980+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T10:39:06.449980+0000","last_undegraded":"2024-04-25T10:39:06.449980+0000","last_fullsized":"2024-04-25T10:39:06.449980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409320+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T10:39:06.409320+0000","last_peered":"2024-04-25T10:39:06.409320+0000","last_clean":"2024-04-25T10:39:06.409320+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T10:39:06.409320+0000","last_undegraded":"2024-04-25T10:39:06.409320+0000","last_fullsized":"2024-04-25T10:39:06.409320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375570+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T10:39:05.375570+0000","last_peered":"2024-04-25T10:39:05.375570+0000","last_clean":"2024-04-25T10:39:05.375570+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T10:39:05.375570+0000","last_undegraded":"2024-04-25T10:39:05.375570+0000","last_fullsized":"2024-04-25T10:39:05.375570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807891+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T10:39:23.807891+0000","last_peered":"2024-04-25T10:39:23.807891+0000","last_clean":"2024-04-25T10:39:23.807891+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T10:39:23.807891+0000","last_undegraded":"2024-04-25T10:39:23.807891+0000","last_fullsized":"2024-04-25T10:39:23.807891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451376+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T10:39:06.451376+0000","last_peered":"2024-04-25T10:39:06.451376+0000","last_clean":"2024-04-25T10:39:06.451376+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T10:39:06.451376+0000","last_undegraded":"2024-04-25T10:39:06.451376+0000","last_fullsized":"2024-04-25T10:39:06.451376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408308+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T10:39:06.408308+0000","last_peered":"2024-04-25T10:39:06.408308+0000","last_clean":"2024-04-25T10:39:06.408308+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T10:39:06.408308+0000","last_undegraded":"2024-04-25T10:39:06.408308+0000","last_fullsized":"2024-04-25T10:39:06.408308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804664+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T10:39:23.804664+0000","last_peered":"2024-04-25T10:39:23.804664+0000","last_clean":"2024-04-25T10:39:23.804664+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T10:39:23.804664+0000","last_undegraded":"2024-04-25T10:39:23.804664+0000","last_fullsized":"2024-04-25T10:39:23.804664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409798+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T10:39:06.409798+0000","last_peered":"2024-04-25T10:39:06.409798+0000","last_clean":"2024-04-25T10:39:06.409798+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T10:39:06.409798+0000","last_undegraded":"2024-04-25T10:39:06.409798+0000","last_fullsized":"2024-04-25T10:39:06.409798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372078+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T10:39:06.372078+0000","last_peered":"2024-04-25T10:39:06.372078+0000","last_clean":"2024-04-25T10:39:06.372078+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T10:39:06.372078+0000","last_undegraded":"2024-04-25T10:39:06.372078+0000","last_fullsized":"2024-04-25T10:39:06.372078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808734+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T10:39:23.808734+0000","last_peered":"2024-04-25T10:39:23.808734+0000","last_clean":"2024-04-25T10:39:23.808734+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T10:39:23.808734+0000","last_undegraded":"2024-04-25T10:39:23.808734+0000","last_fullsized":"2024-04-25T10:39:23.808734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408232+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T10:39:06.408232+0000","last_peered":"2024-04-25T10:39:06.408232+0000","last_clean":"2024-04-25T10:39:06.408232+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T10:39:06.408232+0000","last_undegraded":"2024-04-25T10:39:06.408232+0000","last_fullsized":"2024-04-25T10:39:06.408232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376780+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T10:39:05.376780+0000","last_peered":"2024-04-25T10:39:05.376780+0000","last_clean":"2024-04-25T10:39:05.376780+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T10:39:05.376780+0000","last_undegraded":"2024-04-25T10:39:05.376780+0000","last_fullsized":"2024-04-25T10:39:05.376780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811522+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T10:39:24.811522+0000","last_peered":"2024-04-25T10:39:24.811522+0000","last_clean":"2024-04-25T10:39:24.811522+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T10:39:24.811522+0000","last_undegraded":"2024-04-25T10:39:24.811522+0000","last_fullsized":"2024-04-25T10:39:24.811522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375180+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T10:39:05.375180+0000","last_peered":"2024-04-25T10:39:05.375180+0000","last_clean":"2024-04-25T10:39:05.375180+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T10:39:05.375180+0000","last_undegraded":"2024-04-25T10:39:05.375180+0000","last_fullsized":"2024-04-25T10:39:05.375180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450786+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T10:39:06.450786+0000","last_peered":"2024-04-25T10:39:06.450786+0000","last_clean":"2024-04-25T10:39:06.450786+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T10:39:06.450786+0000","last_undegraded":"2024-04-25T10:39:06.450786+0000","last_fullsized":"2024-04-25T10:39:06.450786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263127+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T10:39:06.263127+0000","last_peered":"2024-04-25T10:39:06.263127+0000","last_clean":"2024-04-25T10:39:06.263127+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T10:39:06.263127+0000","last_undegraded":"2024-04-25T10:39:06.263127+0000","last_fullsized":"2024-04-25T10:39:06.263127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371458+0000","last_change":"2024-04-25T10:39:04.075522+0000","last_active":"2024-04-25T10:39:06.371458+0000","last_peered":"2024-04-25T10:39:06.371458+0000","last_clean":"2024-04-25T10:39:06.371458+0000","last_became_active":"2024-04-25T10:39:04.074914+0000","last_became_peered":"2024-04-25T10:39:04.074914+0000","last_unstale":"2024-04-25T10:39:06.371458+0000","last_undegraded":"2024-04-25T10:39:06.371458+0000","last_fullsized":"2024-04-25T10:39:06.371458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381205+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T10:39:05.381205+0000","last_peered":"2024-04-25T10:39:05.381205+0000","last_clean":"2024-04-25T10:39:05.381205+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T10:39:05.381205+0000","last_undegraded":"2024-04-25T10:39:05.381205+0000","last_fullsized":"2024-04-25T10:39:05.381205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450880+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T10:39:06.450880+0000","last_peered":"2024-04-25T10:39:06.450880+0000","last_clean":"2024-04-25T10:39:06.450880+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T10:39:06.450880+0000","last_undegraded":"2024-04-25T10:39:06.450880+0000","last_fullsized":"2024-04-25T10:39:06.450880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450432+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T10:39:06.450432+0000","last_peered":"2024-04-25T10:39:06.450432+0000","last_clean":"2024-04-25T10:39:06.450432+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T10:39:06.450432+0000","last_undegraded":"2024-04-25T10:39:06.450432+0000","last_fullsized":"2024-04-25T10:39:06.450432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409748+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T10:39:06.409748+0000","last_peered":"2024-04-25T10:39:06.409748+0000","last_clean":"2024-04-25T10:39:06.409748+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T10:39:06.409748+0000","last_undegraded":"2024-04-25T10:39:06.409748+0000","last_fullsized":"2024-04-25T10:39:06.409748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381353+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T10:39:05.381353+0000","last_peered":"2024-04-25T10:39:05.381353+0000","last_clean":"2024-04-25T10:39:05.381353+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T10:39:05.381353+0000","last_undegraded":"2024-04-25T10:39:05.381353+0000","last_fullsized":"2024-04-25T10:39:05.381353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450864+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T10:39:06.450864+0000","last_peered":"2024-04-25T10:39:06.450864+0000","last_clean":"2024-04-25T10:39:06.450864+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T10:39:06.450864+0000","last_undegraded":"2024-04-25T10:39:06.450864+0000","last_fullsized":"2024-04-25T10:39:06.450864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450419+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T10:39:06.450419+0000","last_peered":"2024-04-25T10:39:06.450419+0000","last_clean":"2024-04-25T10:39:06.450419+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T10:39:06.450419+0000","last_undegraded":"2024-04-25T10:39:06.450419+0000","last_fullsized":"2024-04-25T10:39:06.450419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812672+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T10:39:24.812672+0000","last_peered":"2024-04-25T10:39:24.812672+0000","last_clean":"2024-04-25T10:39:24.812672+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T10:39:24.812672+0000","last_undegraded":"2024-04-25T10:39:24.812672+0000","last_fullsized":"2024-04-25T10:39:24.812672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451427+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T10:39:06.451427+0000","last_peered":"2024-04-25T10:39:06.451427+0000","last_clean":"2024-04-25T10:39:06.451427+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T10:39:06.451427+0000","last_undegraded":"2024-04-25T10:39:06.451427+0000","last_fullsized":"2024-04-25T10:39:06.451427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371193+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T10:39:06.371193+0000","last_peered":"2024-04-25T10:39:06.371193+0000","last_clean":"2024-04-25T10:39:06.371193+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T10:39:06.371193+0000","last_undegraded":"2024-04-25T10:39:06.371193+0000","last_fullsized":"2024-04-25T10:39:06.371193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811354+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T10:39:24.811354+0000","last_peered":"2024-04-25T10:39:24.811354+0000","last_clean":"2024-04-25T10:39:24.811354+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T10:39:24.811354+0000","last_undegraded":"2024-04-25T10:39:24.811354+0000","last_fullsized":"2024-04-25T10:39:24.811354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372014+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T10:39:06.372014+0000","last_peered":"2024-04-25T10:39:06.372014+0000","last_clean":"2024-04-25T10:39:06.372014+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T10:39:06.372014+0000","last_undegraded":"2024-04-25T10:39:06.372014+0000","last_fullsized":"2024-04-25T10:39:06.372014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376170+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T10:39:05.376170+0000","last_peered":"2024-04-25T10:39:05.376170+0000","last_clean":"2024-04-25T10:39:05.376170+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T10:39:05.376170+0000","last_undegraded":"2024-04-25T10:39:05.376170+0000","last_fullsized":"2024-04-25T10:39:05.376170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.806571+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T10:39:23.806571+0000","last_peered":"2024-04-25T10:39:23.806571+0000","last_clean":"2024-04-25T10:39:23.806571+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T10:39:23.806571+0000","last_undegraded":"2024-04-25T10:39:23.806571+0000","last_fullsized":"2024-04-25T10:39:23.806571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261513+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T10:39:06.261513+0000","last_peered":"2024-04-25T10:39:06.261513+0000","last_clean":"2024-04-25T10:39:06.261513+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T10:39:06.261513+0000","last_undegraded":"2024-04-25T10:39:06.261513+0000","last_fullsized":"2024-04-25T10:39:06.261513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383275+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T10:39:05.383275+0000","last_peered":"2024-04-25T10:39:05.383275+0000","last_clean":"2024-04-25T10:39:05.383275+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T10:39:05.383275+0000","last_undegraded":"2024-04-25T10:39:05.383275+0000","last_fullsized":"2024-04-25T10:39:05.383275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261803+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T10:39:06.261803+0000","last_peered":"2024-04-25T10:39:06.261803+0000","last_clean":"2024-04-25T10:39:06.261803+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T10:39:06.261803+0000","last_undegraded":"2024-04-25T10:39:06.261803+0000","last_fullsized":"2024-04-25T10:39:06.261803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812418+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T10:39:24.812418+0000","last_peered":"2024-04-25T10:39:24.812418+0000","last_clean":"2024-04-25T10:39:24.812418+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T10:39:24.812418+0000","last_undegraded":"2024-04-25T10:39:24.812418+0000","last_fullsized":"2024-04-25T10:39:24.812418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379226+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T10:39:05.379226+0000","last_peered":"2024-04-25T10:39:05.379226+0000","last_clean":"2024-04-25T10:39:05.379226+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T10:39:05.379226+0000","last_undegraded":"2024-04-25T10:39:05.379226+0000","last_fullsized":"2024-04-25T10:39:05.379226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382589+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T10:39:05.382589+0000","last_peered":"2024-04-25T10:39:05.382589+0000","last_clean":"2024-04-25T10:39:05.382589+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T10:39:05.382589+0000","last_undegraded":"2024-04-25T10:39:05.382589+0000","last_fullsized":"2024-04-25T10:39:05.382589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450997+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T10:39:06.450997+0000","last_peered":"2024-04-25T10:39:06.450997+0000","last_clean":"2024-04-25T10:39:06.450997+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T10:39:06.450997+0000","last_undegraded":"2024-04-25T10:39:06.450997+0000","last_fullsized":"2024-04-25T10:39:06.450997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371805+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T10:39:06.371805+0000","last_peered":"2024-04-25T10:39:06.371805+0000","last_clean":"2024-04-25T10:39:06.371805+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T10:39:06.371805+0000","last_undegraded":"2024-04-25T10:39:06.371805+0000","last_fullsized":"2024-04-25T10:39:06.371805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263444+0000","last_change":"2024-04-25T10:38:59.376270+0000","last_active":"2024-04-25T10:39:06.263444+0000","last_peered":"2024-04-25T10:39:06.263444+0000","last_clean":"2024-04-25T10:39:06.263444+0000","last_became_active":"2024-04-25T10:38:59.375839+0000","last_became_peered":"2024-04-25T10:38:59.375839+0000","last_unstale":"2024-04-25T10:39:06.263444+0000","last_undegraded":"2024-04-25T10:39:06.263444+0000","last_fullsized":"2024-04-25T10:39:06.263444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:43.103655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407337+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T10:39:06.407337+0000","last_peered":"2024-04-25T10:39:06.407337+0000","last_clean":"2024-04-25T10:39:06.407337+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T10:39:06.407337+0000","last_undegraded":"2024-04-25T10:39:06.407337+0000","last_fullsized":"2024-04-25T10:39:06.407337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378738+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T10:39:05.378738+0000","last_peered":"2024-04-25T10:39:05.378738+0000","last_clean":"2024-04-25T10:39:05.378738+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T10:39:05.378738+0000","last_undegraded":"2024-04-25T10:39:05.378738+0000","last_fullsized":"2024-04-25T10:39:05.378738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262545+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T10:39:06.262545+0000","last_peered":"2024-04-25T10:39:06.262545+0000","last_clean":"2024-04-25T10:39:06.262545+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T10:39:06.262545+0000","last_undegraded":"2024-04-25T10:39:06.262545+0000","last_fullsized":"2024-04-25T10:39:06.262545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.410225+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T10:39:06.410225+0000","last_peered":"2024-04-25T10:39:06.410225+0000","last_clean":"2024-04-25T10:39:06.410225+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T10:39:06.410225+0000","last_undegraded":"2024-04-25T10:39:06.410225+0000","last_fullsized":"2024-04-25T10:39:06.410225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407296+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T10:39:06.407296+0000","last_peered":"2024-04-25T10:39:06.407296+0000","last_clean":"2024-04-25T10:39:06.407296+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T10:39:06.407296+0000","last_undegraded":"2024-04-25T10:39:06.407296+0000","last_fullsized":"2024-04-25T10:39:06.407296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263350+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T10:39:06.263350+0000","last_peered":"2024-04-25T10:39:06.263350+0000","last_clean":"2024-04-25T10:39:06.263350+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T10:39:06.263350+0000","last_undegraded":"2024-04-25T10:39:06.263350+0000","last_fullsized":"2024-04-25T10:39:06.263350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813380+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T10:39:24.813380+0000","last_peered":"2024-04-25T10:39:24.813380+0000","last_clean":"2024-04-25T10:39:24.813380+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T10:39:24.813380+0000","last_undegraded":"2024-04-25T10:39:24.813380+0000","last_fullsized":"2024-04-25T10:39:24.813380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371797+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T10:39:06.371797+0000","last_peered":"2024-04-25T10:39:06.371797+0000","last_clean":"2024-04-25T10:39:06.371797+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T10:39:06.371797+0000","last_undegraded":"2024-04-25T10:39:06.371797+0000","last_fullsized":"2024-04-25T10:39:06.371797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379998+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T10:39:05.379998+0000","last_peered":"2024-04-25T10:39:05.379998+0000","last_clean":"2024-04-25T10:39:05.379998+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T10:39:05.379998+0000","last_undegraded":"2024-04-25T10:39:05.379998+0000","last_fullsized":"2024-04-25T10:39:05.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812430+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T10:39:24.812430+0000","last_peered":"2024-04-25T10:39:24.812430+0000","last_clean":"2024-04-25T10:39:24.812430+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T10:39:24.812430+0000","last_undegraded":"2024-04-25T10:39:24.812430+0000","last_fullsized":"2024-04-25T10:39:24.812430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376592+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T10:39:05.376592+0000","last_peered":"2024-04-25T10:39:05.376592+0000","last_clean":"2024-04-25T10:39:05.376592+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T10:39:05.376592+0000","last_undegraded":"2024-04-25T10:39:05.376592+0000","last_fullsized":"2024-04-25T10:39:05.376592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262028+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T10:39:06.262028+0000","last_peered":"2024-04-25T10:39:06.262028+0000","last_clean":"2024-04-25T10:39:06.262028+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T10:39:06.262028+0000","last_undegraded":"2024-04-25T10:39:06.262028+0000","last_fullsized":"2024-04-25T10:39:06.262028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804398+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T10:39:23.804398+0000","last_peered":"2024-04-25T10:39:23.804398+0000","last_clean":"2024-04-25T10:39:23.804398+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T10:39:23.804398+0000","last_undegraded":"2024-04-25T10:39:23.804398+0000","last_fullsized":"2024-04-25T10:39:23.804398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376022+0000","last_change":"2024-04-25T10:39:04.075730+0000","last_active":"2024-04-25T10:39:05.376022+0000","last_peered":"2024-04-25T10:39:05.376022+0000","last_clean":"2024-04-25T10:39:05.376022+0000","last_became_active":"2024-04-25T10:39:04.074100+0000","last_became_peered":"2024-04-25T10:39:04.074100+0000","last_unstale":"2024-04-25T10:39:05.376022+0000","last_undegraded":"2024-04-25T10:39:05.376022+0000","last_fullsized":"2024-04-25T10:39:05.376022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371541+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T10:39:06.371541+0000","last_peered":"2024-04-25T10:39:06.371541+0000","last_clean":"2024-04-25T10:39:06.371541+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T10:39:06.371541+0000","last_undegraded":"2024-04-25T10:39:06.371541+0000","last_fullsized":"2024-04-25T10:39:06.371541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813673+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T10:39:24.813673+0000","last_peered":"2024-04-25T10:39:24.813673+0000","last_clean":"2024-04-25T10:39:24.813673+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T10:39:24.813673+0000","last_undegraded":"2024-04-25T10:39:24.813673+0000","last_fullsized":"2024-04-25T10:39:24.813673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380495+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T10:39:05.380495+0000","last_peered":"2024-04-25T10:39:05.380495+0000","last_clean":"2024-04-25T10:39:05.380495+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T10:39:05.380495+0000","last_undegraded":"2024-04-25T10:39:05.380495+0000","last_fullsized":"2024-04-25T10:39:05.380495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261538+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T10:39:06.261538+0000","last_peered":"2024-04-25T10:39:06.261538+0000","last_clean":"2024-04-25T10:39:06.261538+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T10:39:06.261538+0000","last_undegraded":"2024-04-25T10:39:06.261538+0000","last_fullsized":"2024-04-25T10:39:06.261538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.801119+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T10:39:23.801119+0000","last_peered":"2024-04-25T10:39:23.801119+0000","last_clean":"2024-04-25T10:39:23.801119+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T10:39:23.801119+0000","last_undegraded":"2024-04-25T10:39:23.801119+0000","last_fullsized":"2024-04-25T10:39:23.801119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450574+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T10:39:06.450574+0000","last_peered":"2024-04-25T10:39:06.450574+0000","last_clean":"2024-04-25T10:39:06.450574+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T10:39:06.450574+0000","last_undegraded":"2024-04-25T10:39:06.450574+0000","last_fullsized":"2024-04-25T10:39:06.450574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409684+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T10:39:06.409684+0000","last_peered":"2024-04-25T10:39:06.409684+0000","last_clean":"2024-04-25T10:39:06.409684+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T10:39:06.409684+0000","last_undegraded":"2024-04-25T10:39:06.409684+0000","last_fullsized":"2024-04-25T10:39:06.409684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450019+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T10:39:06.450019+0000","last_peered":"2024-04-25T10:39:06.450019+0000","last_clean":"2024-04-25T10:39:06.450019+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T10:39:06.450019+0000","last_undegraded":"2024-04-25T10:39:06.450019+0000","last_fullsized":"2024-04-25T10:39:06.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409205+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T10:39:06.409205+0000","last_peered":"2024-04-25T10:39:06.409205+0000","last_clean":"2024-04-25T10:39:06.409205+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T10:39:06.409205+0000","last_undegraded":"2024-04-25T10:39:06.409205+0000","last_fullsized":"2024-04-25T10:39:06.409205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372045+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T10:39:06.372045+0000","last_peered":"2024-04-25T10:39:06.372045+0000","last_clean":"2024-04-25T10:39:06.372045+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T10:39:06.372045+0000","last_undegraded":"2024-04-25T10:39:06.372045+0000","last_fullsized":"2024-04-25T10:39:06.372045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807641+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T10:39:23.807641+0000","last_peered":"2024-04-25T10:39:23.807641+0000","last_clean":"2024-04-25T10:39:23.807641+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T10:39:23.807641+0000","last_undegraded":"2024-04-25T10:39:23.807641+0000","last_fullsized":"2024-04-25T10:39:23.807641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375418+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T10:39:05.375418+0000","last_peered":"2024-04-25T10:39:05.375418+0000","last_clean":"2024-04-25T10:39:05.375418+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T10:39:05.375418+0000","last_undegraded":"2024-04-25T10:39:05.375418+0000","last_fullsized":"2024-04-25T10:39:05.375418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382417+0000","last_change":"2024-04-25T10:38:59.353750+0000","last_active":"2024-04-25T10:39:05.382417+0000","last_peered":"2024-04-25T10:39:05.382417+0000","last_clean":"2024-04-25T10:39:05.382417+0000","last_became_active":"2024-04-25T10:38:59.353056+0000","last_became_peered":"2024-04-25T10:38:59.353056+0000","last_unstale":"2024-04-25T10:39:05.382417+0000","last_undegraded":"2024-04-25T10:39:05.382417+0000","last_fullsized":"2024-04-25T10:39:05.382417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808876+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T10:39:23.808876+0000","last_peered":"2024-04-25T10:39:23.808876+0000","last_clean":"2024-04-25T10:39:23.808876+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T10:39:23.808876+0000","last_undegraded":"2024-04-25T10:39:23.808876+0000","last_fullsized":"2024-04-25T10:39:23.808876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375377+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T10:39:05.375377+0000","last_peered":"2024-04-25T10:39:05.375377+0000","last_clean":"2024-04-25T10:39:05.375377+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T10:39:05.375377+0000","last_undegraded":"2024-04-25T10:39:05.375377+0000","last_fullsized":"2024-04-25T10:39:05.375377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371727+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T10:39:06.371727+0000","last_peered":"2024-04-25T10:39:06.371727+0000","last_clean":"2024-04-25T10:39:06.371727+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T10:39:06.371727+0000","last_undegraded":"2024-04-25T10:39:06.371727+0000","last_fullsized":"2024-04-25T10:39:06.371727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450212+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T10:39:06.450212+0000","last_peered":"2024-04-25T10:39:06.450212+0000","last_clean":"2024-04-25T10:39:06.450212+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T10:39:06.450212+0000","last_undegraded":"2024-04-25T10:39:06.450212+0000","last_fullsized":"2024-04-25T10:39:06.450212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381633+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T10:39:05.381633+0000","last_peered":"2024-04-25T10:39:05.381633+0000","last_clean":"2024-04-25T10:39:05.381633+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T10:39:05.381633+0000","last_undegraded":"2024-04-25T10:39:05.381633+0000","last_fullsized":"2024-04-25T10:39:05.381633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383599+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T10:39:05.383599+0000","last_peered":"2024-04-25T10:39:05.383599+0000","last_clean":"2024-04-25T10:39:05.383599+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T10:39:05.383599+0000","last_undegraded":"2024-04-25T10:39:05.383599+0000","last_fullsized":"2024-04-25T10:39:05.383599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375402+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T10:39:05.375402+0000","last_peered":"2024-04-25T10:39:05.375402+0000","last_clean":"2024-04-25T10:39:05.375402+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T10:39:05.375402+0000","last_undegraded":"2024-04-25T10:39:05.375402+0000","last_fullsized":"2024-04-25T10:39:05.375402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812861+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T10:39:24.812861+0000","last_peered":"2024-04-25T10:39:24.812861+0000","last_clean":"2024-04-25T10:39:24.812861+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T10:39:24.812861+0000","last_undegraded":"2024-04-25T10:39:24.812861+0000","last_fullsized":"2024-04-25T10:39:24.812861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811253+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T10:39:24.811253+0000","last_peered":"2024-04-25T10:39:24.811253+0000","last_clean":"2024-04-25T10:39:24.811253+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T10:39:24.811253+0000","last_undegraded":"2024-04-25T10:39:24.811253+0000","last_fullsized":"2024-04-25T10:39:24.811253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371915+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T10:39:06.371915+0000","last_peered":"2024-04-25T10:39:06.371915+0000","last_clean":"2024-04-25T10:39:06.371915+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T10:39:06.371915+0000","last_undegraded":"2024-04-25T10:39:06.371915+0000","last_fullsized":"2024-04-25T10:39:06.371915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407786+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T10:39:06.407786+0000","last_peered":"2024-04-25T10:39:06.407786+0000","last_clean":"2024-04-25T10:39:06.407786+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T10:39:06.407786+0000","last_undegraded":"2024-04-25T10:39:06.407786+0000","last_fullsized":"2024-04-25T10:39:06.407786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.810784+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T10:39:23.810784+0000","last_peered":"2024-04-25T10:39:23.810784+0000","last_clean":"2024-04-25T10:39:23.810784+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T10:39:23.810784+0000","last_undegraded":"2024-04-25T10:39:23.810784+0000","last_fullsized":"2024-04-25T10:39:23.810784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408790+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T10:39:06.408790+0000","last_peered":"2024-04-25T10:39:06.408790+0000","last_clean":"2024-04-25T10:39:06.408790+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T10:39:06.408790+0000","last_undegraded":"2024-04-25T10:39:06.408790+0000","last_fullsized":"2024-04-25T10:39:06.408790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376153+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T10:39:05.376153+0000","last_peered":"2024-04-25T10:39:05.376153+0000","last_clean":"2024-04-25T10:39:05.376153+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T10:39:05.376153+0000","last_undegraded":"2024-04-25T10:39:05.376153+0000","last_fullsized":"2024-04-25T10:39:05.376153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379483+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T10:39:05.379483+0000","last_peered":"2024-04-25T10:39:05.379483+0000","last_clean":"2024-04-25T10:39:05.379483+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T10:39:05.379483+0000","last_undegraded":"2024-04-25T10:39:05.379483+0000","last_fullsized":"2024-04-25T10:39:05.379483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407574+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T10:39:06.407574+0000","last_peered":"2024-04-25T10:39:06.407574+0000","last_clean":"2024-04-25T10:39:06.407574+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T10:39:06.407574+0000","last_undegraded":"2024-04-25T10:39:06.407574+0000","last_fullsized":"2024-04-25T10:39:06.407574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380900+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T10:39:05.380900+0000","last_peered":"2024-04-25T10:39:05.380900+0000","last_clean":"2024-04-25T10:39:05.380900+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T10:39:05.380900+0000","last_undegraded":"2024-04-25T10:39:05.380900+0000","last_fullsized":"2024-04-25T10:39:05.380900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371754+0000","last_change":"2024-04-25T10:38:59.335488+0000","last_active":"2024-04-25T10:39:06.371754+0000","last_peered":"2024-04-25T10:39:06.371754+0000","last_clean":"2024-04-25T10:39:06.371754+0000","last_became_active":"2024-04-25T10:38:59.335116+0000","last_became_peered":"2024-04-25T10:38:59.335116+0000","last_unstale":"2024-04-25T10:39:06.371754+0000","last_undegraded":"2024-04-25T10:39:06.371754+0000","last_fullsized":"2024-04-25T10:39:06.371754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376240+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T10:39:05.376240+0000","last_peered":"2024-04-25T10:39:05.376240+0000","last_clean":"2024-04-25T10:39:05.376240+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T10:39:05.376240+0000","last_undegraded":"2024-04-25T10:39:05.376240+0000","last_fullsized":"2024-04-25T10:39:05.376240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450833+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T10:39:06.450833+0000","last_peered":"2024-04-25T10:39:06.450833+0000","last_clean":"2024-04-25T10:39:06.450833+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T10:39:06.450833+0000","last_undegraded":"2024-04-25T10:39:06.450833+0000","last_fullsized":"2024-04-25T10:39:06.450833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384578+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T10:39:05.384578+0000","last_peered":"2024-04-25T10:39:05.384578+0000","last_clean":"2024-04-25T10:39:05.384578+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T10:39:05.384578+0000","last_undegraded":"2024-04-25T10:39:05.384578+0000","last_fullsized":"2024-04-25T10:39:05.384578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376701+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T10:39:05.376701+0000","last_peered":"2024-04-25T10:39:05.376701+0000","last_clean":"2024-04-25T10:39:05.376701+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T10:39:05.376701+0000","last_undegraded":"2024-04-25T10:39:05.376701+0000","last_fullsized":"2024-04-25T10:39:05.376701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379166+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T10:39:05.379166+0000","last_peered":"2024-04-25T10:39:05.379166+0000","last_clean":"2024-04-25T10:39:05.379166+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T10:39:05.379166+0000","last_undegraded":"2024-04-25T10:39:05.379166+0000","last_fullsized":"2024-04-25T10:39:05.379166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375532+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T10:39:05.375532+0000","last_peered":"2024-04-25T10:39:05.375532+0000","last_clean":"2024-04-25T10:39:05.375532+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T10:39:05.375532+0000","last_undegraded":"2024-04-25T10:39:05.375532+0000","last_fullsized":"2024-04-25T10:39:05.375532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380616+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T10:39:05.380616+0000","last_peered":"2024-04-25T10:39:05.380616+0000","last_clean":"2024-04-25T10:39:05.380616+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T10:39:05.380616+0000","last_undegraded":"2024-04-25T10:39:05.380616+0000","last_fullsized":"2024-04-25T10:39:05.380616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371579+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T10:39:06.371579+0000","last_peered":"2024-04-25T10:39:06.371579+0000","last_clean":"2024-04-25T10:39:06.371579+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T10:39:06.371579+0000","last_undegraded":"2024-04-25T10:39:06.371579+0000","last_fullsized":"2024-04-25T10:39:06.371579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384073+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T10:39:05.384073+0000","last_peered":"2024-04-25T10:39:05.384073+0000","last_clean":"2024-04-25T10:39:05.384073+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T10:39:05.384073+0000","last_undegraded":"2024-04-25T10:39:05.384073+0000","last_fullsized":"2024-04-25T10:39:05.384073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262884+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T10:39:06.262884+0000","last_peered":"2024-04-25T10:39:06.262884+0000","last_clean":"2024-04-25T10:39:06.262884+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T10:39:06.262884+0000","last_undegraded":"2024-04-25T10:39:06.262884+0000","last_fullsized":"2024-04-25T10:39:06.262884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407870+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T10:39:06.407870+0000","last_peered":"2024-04-25T10:39:06.407870+0000","last_clean":"2024-04-25T10:39:06.407870+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T10:39:06.407870+0000","last_undegraded":"2024-04-25T10:39:06.407870+0000","last_fullsized":"2024-04-25T10:39:06.407870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382695+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T10:39:05.382695+0000","last_peered":"2024-04-25T10:39:05.382695+0000","last_clean":"2024-04-25T10:39:05.382695+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T10:39:05.382695+0000","last_undegraded":"2024-04-25T10:39:05.382695+0000","last_fullsized":"2024-04-25T10:39:05.382695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378766+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T10:39:05.378766+0000","last_peered":"2024-04-25T10:39:05.378766+0000","last_clean":"2024-04-25T10:39:05.378766+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T10:39:05.378766+0000","last_undegraded":"2024-04-25T10:39:05.378766+0000","last_fullsized":"2024-04-25T10:39:05.378766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450284+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T10:39:06.450284+0000","last_peered":"2024-04-25T10:39:06.450284+0000","last_clean":"2024-04-25T10:39:06.450284+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T10:39:06.450284+0000","last_undegraded":"2024-04-25T10:39:06.450284+0000","last_fullsized":"2024-04-25T10:39:06.450284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371478+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T10:39:06.371478+0000","last_peered":"2024-04-25T10:39:06.371478+0000","last_clean":"2024-04-25T10:39:06.371478+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T10:39:06.371478+0000","last_undegraded":"2024-04-25T10:39:06.371478+0000","last_fullsized":"2024-04-25T10:39:06.371478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376036+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T10:39:05.376036+0000","last_peered":"2024-04-25T10:39:05.376036+0000","last_clean":"2024-04-25T10:39:05.376036+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T10:39:05.376036+0000","last_undegraded":"2024-04-25T10:39:05.376036+0000","last_fullsized":"2024-04-25T10:39:05.376036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409436+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T10:39:06.409436+0000","last_peered":"2024-04-25T10:39:06.409436+0000","last_clean":"2024-04-25T10:39:06.409436+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T10:39:06.409436+0000","last_undegraded":"2024-04-25T10:39:06.409436+0000","last_fullsized":"2024-04-25T10:39:06.409436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383406+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T10:39:05.383406+0000","last_peered":"2024-04-25T10:39:05.383406+0000","last_clean":"2024-04-25T10:39:05.383406+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T10:39:05.383406+0000","last_undegraded":"2024-04-25T10:39:05.383406+0000","last_fullsized":"2024-04-25T10:39:05.383406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384611+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T10:39:05.384611+0000","last_peered":"2024-04-25T10:39:05.384611+0000","last_clean":"2024-04-25T10:39:05.384611+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T10:39:05.384611+0000","last_undegraded":"2024-04-25T10:39:05.384611+0000","last_fullsized":"2024-04-25T10:39:05.384611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263214+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T10:39:06.263214+0000","last_peered":"2024-04-25T10:39:06.263214+0000","last_clean":"2024-04-25T10:39:06.263214+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T10:39:06.263214+0000","last_undegraded":"2024-04-25T10:39:06.263214+0000","last_fullsized":"2024-04-25T10:39:06.263214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375273+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T10:39:05.375273+0000","last_peered":"2024-04-25T10:39:05.375273+0000","last_clean":"2024-04-25T10:39:05.375273+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T10:39:05.375273+0000","last_undegraded":"2024-04-25T10:39:05.375273+0000","last_fullsized":"2024-04-25T10:39:05.375273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262803+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T10:39:06.262803+0000","last_peered":"2024-04-25T10:39:06.262803+0000","last_clean":"2024-04-25T10:39:06.262803+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T10:39:06.262803+0000","last_undegraded":"2024-04-25T10:39:06.262803+0000","last_fullsized":"2024-04-25T10:39:06.262803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380508+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T10:39:05.380508+0000","last_peered":"2024-04-25T10:39:05.380508+0000","last_clean":"2024-04-25T10:39:05.380508+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T10:39:05.380508+0000","last_undegraded":"2024-04-25T10:39:05.380508+0000","last_fullsized":"2024-04-25T10:39:05.380508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261606+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T10:39:06.261606+0000","last_peered":"2024-04-25T10:39:06.261606+0000","last_clean":"2024-04-25T10:39:06.261606+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T10:39:06.261606+0000","last_undegraded":"2024-04-25T10:39:06.261606+0000","last_fullsized":"2024-04-25T10:39:06.261606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382113+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T10:39:05.382113+0000","last_peered":"2024-04-25T10:39:05.382113+0000","last_clean":"2024-04-25T10:39:05.382113+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T10:39:05.382113+0000","last_undegraded":"2024-04-25T10:39:05.382113+0000","last_fullsized":"2024-04-25T10:39:05.382113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371520+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T10:39:06.371520+0000","last_peered":"2024-04-25T10:39:06.371520+0000","last_clean":"2024-04-25T10:39:06.371520+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T10:39:06.371520+0000","last_undegraded":"2024-04-25T10:39:06.371520+0000","last_fullsized":"2024-04-25T10:39:06.371520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451173+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T10:39:06.451173+0000","last_peered":"2024-04-25T10:39:06.451173+0000","last_clean":"2024-04-25T10:39:06.451173+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T10:39:06.451173+0000","last_undegraded":"2024-04-25T10:39:06.451173+0000","last_fullsized":"2024-04-25T10:39:06.451173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262865+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T10:39:06.262865+0000","last_peered":"2024-04-25T10:39:06.262865+0000","last_clean":"2024-04-25T10:39:06.262865+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T10:39:06.262865+0000","last_undegraded":"2024-04-25T10:39:06.262865+0000","last_fullsized":"2024-04-25T10:39:06.262865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":703748,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":112826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":116528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":703092,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:39:26.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:39:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.171+0000 7fb0f4c00640 1 Processor -- start 2024-04-25T10:39:27.177 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.171+0000 7fb0f4c00640 1 -- start start 2024-04-25T10:39:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0f4c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb0f00ca730 0x7fb0f00c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0f4c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f0159cb0 0x7fb0f00b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0f4c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0f00705c0 con 0x7fb0f00b25f0 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0f4c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb0f00c41d0 con 0x7fb0f00ca730 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0f4c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f0070880 con 0x7fb0f0159cb0 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb0f00ca730 0x7fb0f00c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ee800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb0f00b25f0 0x7fb0f015d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38412/0 (socket says 172.21.15.16:38412) 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ee800640 1 -- 172.21.15.16:0/4292698270 learned_addr learned my addr 172.21.15.16:0/4292698270 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 --2- 172.21.15.16:0/4292698270 >> v2:172.21.15.16:3300/0 conn(0x7fb0f00ca730 0x7fb0f00c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46602/0 (socket says 172.21.15.16:46602) 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0e7e00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f0159cb0 0x7fb0f00b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 -- 172.21.15.16:0/4292698270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f0159cb0 msgr2=0x7fb0f00b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f0159cb0 0x7fb0f00b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 -- 172.21.15.16:0/4292698270 >> v1:172.21.15.16:6789/0 conn(0x7fb0f00b25f0 legacy=0x7fb0f015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ede00640 1 -- 172.21.15.16:0/4292698270 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f0070b60 con 0x7fb0f00ca730 2024-04-25T10:39:27.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.175+0000 7fb0ed400640 1 -- 172.21.15.16:0/4292698270 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670833233 0 0) 0x7fb0f00705c0 con 0x7fb0f00b25f0 2024-04-25T10:39:27.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0ede00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00ca730 0x7fb0f00c49b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009900 tx=0x7fb0e001c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e15f102acadfd72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0ed400640 1 -- 172.21.15.16:0/4292698270 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00a6040 con 0x7fb0f00ca730 2024-04-25T10:39:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0ed400640 1 -- 172.21.15.16:0/4292698270 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e00af070 con 0x7fb0f00ca730 2024-04-25T10:39:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0ed400640 1 -- 172.21.15.16:0/4292698270 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00aa860 con 0x7fb0f00ca730 2024-04-25T10:39:27.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 -- 172.21.15.16:0/4292698270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00ca730 msgr2=0x7fb0f00c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00ca730 0x7fb0f00c49b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0009900 tx=0x7fb0e001c5a0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 -- 172.21.15.16:0/4292698270 shutdown_connections 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f0159cb0 0x7fb0f00b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/4292698270 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00ca730 0x7fb0f00c49b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 -- 172.21.15.16:0/4292698270 >> 172.21.15.16:0/4292698270 conn(0x7fb0f00ce950 msgr2=0x7fb0f00cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 -- 172.21.15.16:0/4292698270 shutdown_connections 2024-04-25T10:39:27.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.179+0000 7fb0f4c00640 1 -- 172.21.15.16:0/4292698270 wait complete. 2024-04-25T10:39:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 Processor -- start 2024-04-25T10:39:27.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- start start 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 0x7fb0f00c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 0x7fb0f01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f00c3da0 con 0x7fb0f00b25f0 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f00c3c20 con 0x7fb0f0159cb0 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f00b35d0 con 0x7fb0f00ca730 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46604/0 (socket says 172.21.15.16:46604) 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 -- 172.21.15.16:0/2935589636 learned_addr learned my addr 172.21.15.16:0/2935589636 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ee800640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 0x7fb0f01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0e7e00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 0x7fb0f00c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 -- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 msgr2=0x7fb0f00c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 0x7fb0f00c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 -- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 msgr2=0x7fb0f01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 0x7fb0f01501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 -- 172.21.15.16:0/2935589636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f00c68f0 con 0x7fb0f00b25f0 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0e7e00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 0x7fb0f00c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:27.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ee800640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 0x7fb0f01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0ede00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0e001ac50 tx=0x7fb0e001ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0006e60 con 0x7fb0f00b25f0 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e00bd610 con 0x7fb0f00b25f0 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f01fb460 con 0x7fb0f00b25f0 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e00bda00 con 0x7fb0f00b25f0 2024-04-25T10:39:27.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.183+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f01fb740 con 0x7fb0f00b25f0 2024-04-25T10:39:27.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f0050750 con 0x7fb0f00b25f0 2024-04-25T10:39:27.191 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb0e00b33f0 con 0x7fb0f00b25f0 2024-04-25T10:39:27.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0e6000640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 0x7fb0c8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0e0129920 con 0x7fb0f00b25f0 2024-04-25T10:39:27.192 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0e7e00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 0x7fb0c8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.187+0000 7fb0e7e00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 0x7fb0c8071ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00b04e0 tx=0x7fb0d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.191+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0e00c3060 con 0x7fb0f00b25f0 2024-04-25T10:39:27.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.351+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0f00c6ac0 con 0x7fb0c806f5a0 2024-04-25T10:39:27.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.375+0000 7fb0e6000640 1 -- 172.21.15.16:0/2935589636 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332776 (secure 0 0 0) 0x7fb0f00c6ac0 con 0x7fb0c806f5a0 2024-04-25T10:39:27.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:27.386 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 msgr2=0x7fb0c8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 0x7fb0c8071ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00b04e0 tx=0x7fb0d8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 msgr2=0x7fb0f014abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb0e001ac50 tx=0x7fb0e001ade0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 shutdown_connections 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb0c806f5a0 0x7fb0c8071ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb0f0159cb0 0x7fb0f01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb0f00ca730 0x7fb0f00c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 --2- 172.21.15.16:0/2935589636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f00b25f0 0x7fb0f014abf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 >> 172.21.15.16:0/2935589636 conn(0x7fb0f00ce950 msgr2=0x7fb0f015b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 shutdown_connections 2024-04-25T10:39:27.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.379+0000 7fb0f4c00640 1 -- 172.21.15.16:0/2935589636 wait complete. 2024-04-25T10:39:27.407 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-25T10:39:25.664753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":229,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231024,"kb_used_data":2416,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743696,"statfs":{"total":773094113280,"available":772857544704,"internally_reserved":0,"allocated":2473984,"data_stored":2089340,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4593,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006250"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812213+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T10:39:24.812213+0000","last_peered":"2024-04-25T10:39:24.812213+0000","last_clean":"2024-04-25T10:39:24.812213+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T10:39:24.812213+0000","last_undegraded":"2024-04-25T10:39:24.812213+0000","last_fullsized":"2024-04-25T10:39:24.812213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376558+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T10:39:05.376558+0000","last_peered":"2024-04-25T10:39:05.376558+0000","last_clean":"2024-04-25T10:39:05.376558+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T10:39:05.376558+0000","last_undegraded":"2024-04-25T10:39:05.376558+0000","last_fullsized":"2024-04-25T10:39:05.376558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375270+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T10:39:05.375270+0000","last_peered":"2024-04-25T10:39:05.375270+0000","last_clean":"2024-04-25T10:39:05.375270+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T10:39:05.375270+0000","last_undegraded":"2024-04-25T10:39:05.375270+0000","last_fullsized":"2024-04-25T10:39:05.375270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376755+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T10:39:05.376755+0000","last_peered":"2024-04-25T10:39:05.376755+0000","last_clean":"2024-04-25T10:39:05.376755+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T10:39:05.376755+0000","last_undegraded":"2024-04-25T10:39:05.376755+0000","last_fullsized":"2024-04-25T10:39:05.376755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371897+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T10:39:06.371897+0000","last_peered":"2024-04-25T10:39:06.371897+0000","last_clean":"2024-04-25T10:39:06.371897+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T10:39:06.371897+0000","last_undegraded":"2024-04-25T10:39:06.371897+0000","last_fullsized":"2024-04-25T10:39:06.371897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407381+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T10:39:06.407381+0000","last_peered":"2024-04-25T10:39:06.407381+0000","last_clean":"2024-04-25T10:39:06.407381+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T10:39:06.407381+0000","last_undegraded":"2024-04-25T10:39:06.407381+0000","last_fullsized":"2024-04-25T10:39:06.407381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812298+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T10:39:24.812298+0000","last_peered":"2024-04-25T10:39:24.812298+0000","last_clean":"2024-04-25T10:39:24.812298+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T10:39:24.812298+0000","last_undegraded":"2024-04-25T10:39:24.812298+0000","last_fullsized":"2024-04-25T10:39:24.812298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382480+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T10:39:05.382480+0000","last_peered":"2024-04-25T10:39:05.382480+0000","last_clean":"2024-04-25T10:39:05.382480+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T10:39:05.382480+0000","last_undegraded":"2024-04-25T10:39:05.382480+0000","last_fullsized":"2024-04-25T10:39:05.382480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408782+0000","last_change":"2024-04-25T10:39:03.421468+0000","last_active":"2024-04-25T10:39:06.408782+0000","last_peered":"2024-04-25T10:39:06.408782+0000","last_clean":"2024-04-25T10:39:06.408782+0000","last_became_active":"2024-04-25T10:39:03.417909+0000","last_became_peered":"2024-04-25T10:39:03.417909+0000","last_unstale":"2024-04-25T10:39:06.408782+0000","last_undegraded":"2024-04-25T10:39:06.408782+0000","last_fullsized":"2024-04-25T10:39:06.408782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:52.327065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261792+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T10:39:06.261792+0000","last_peered":"2024-04-25T10:39:06.261792+0000","last_clean":"2024-04-25T10:39:06.261792+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T10:39:06.261792+0000","last_undegraded":"2024-04-25T10:39:06.261792+0000","last_fullsized":"2024-04-25T10:39:06.261792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380874+0000","last_change":"2024-04-25T10:38:59.354375+0000","last_active":"2024-04-25T10:39:05.380874+0000","last_peered":"2024-04-25T10:39:05.380874+0000","last_clean":"2024-04-25T10:39:05.380874+0000","last_became_active":"2024-04-25T10:38:59.354038+0000","last_became_peered":"2024-04-25T10:38:59.354038+0000","last_unstale":"2024-04-25T10:39:05.380874+0000","last_undegraded":"2024-04-25T10:39:05.380874+0000","last_fullsized":"2024-04-25T10:39:05.380874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408576+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T10:39:06.408576+0000","last_peered":"2024-04-25T10:39:06.408576+0000","last_clean":"2024-04-25T10:39:06.408576+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T10:39:06.408576+0000","last_undegraded":"2024-04-25T10:39:06.408576+0000","last_fullsized":"2024-04-25T10:39:06.408576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382459+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T10:39:05.382459+0000","last_peered":"2024-04-25T10:39:05.382459+0000","last_clean":"2024-04-25T10:39:05.382459+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T10:39:05.382459+0000","last_undegraded":"2024-04-25T10:39:05.382459+0000","last_fullsized":"2024-04-25T10:39:05.382459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.809062+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T10:39:23.809062+0000","last_peered":"2024-04-25T10:39:23.809062+0000","last_clean":"2024-04-25T10:39:23.809062+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T10:39:23.809062+0000","last_undegraded":"2024-04-25T10:39:23.809062+0000","last_fullsized":"2024-04-25T10:39:23.809062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409380+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T10:39:06.409380+0000","last_peered":"2024-04-25T10:39:06.409380+0000","last_clean":"2024-04-25T10:39:06.409380+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T10:39:06.409380+0000","last_undegraded":"2024-04-25T10:39:06.409380+0000","last_fullsized":"2024-04-25T10:39:06.409380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376030+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T10:39:05.376030+0000","last_peered":"2024-04-25T10:39:05.376030+0000","last_clean":"2024-04-25T10:39:05.376030+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T10:39:05.376030+0000","last_undegraded":"2024-04-25T10:39:05.376030+0000","last_fullsized":"2024-04-25T10:39:05.376030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.449980+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T10:39:06.449980+0000","last_peered":"2024-04-25T10:39:06.449980+0000","last_clean":"2024-04-25T10:39:06.449980+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T10:39:06.449980+0000","last_undegraded":"2024-04-25T10:39:06.449980+0000","last_fullsized":"2024-04-25T10:39:06.449980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409320+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T10:39:06.409320+0000","last_peered":"2024-04-25T10:39:06.409320+0000","last_clean":"2024-04-25T10:39:06.409320+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T10:39:06.409320+0000","last_undegraded":"2024-04-25T10:39:06.409320+0000","last_fullsized":"2024-04-25T10:39:06.409320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375570+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T10:39:05.375570+0000","last_peered":"2024-04-25T10:39:05.375570+0000","last_clean":"2024-04-25T10:39:05.375570+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T10:39:05.375570+0000","last_undegraded":"2024-04-25T10:39:05.375570+0000","last_fullsized":"2024-04-25T10:39:05.375570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807891+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T10:39:23.807891+0000","last_peered":"2024-04-25T10:39:23.807891+0000","last_clean":"2024-04-25T10:39:23.807891+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T10:39:23.807891+0000","last_undegraded":"2024-04-25T10:39:23.807891+0000","last_fullsized":"2024-04-25T10:39:23.807891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451376+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T10:39:06.451376+0000","last_peered":"2024-04-25T10:39:06.451376+0000","last_clean":"2024-04-25T10:39:06.451376+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T10:39:06.451376+0000","last_undegraded":"2024-04-25T10:39:06.451376+0000","last_fullsized":"2024-04-25T10:39:06.451376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408308+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T10:39:06.408308+0000","last_peered":"2024-04-25T10:39:06.408308+0000","last_clean":"2024-04-25T10:39:06.408308+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T10:39:06.408308+0000","last_undegraded":"2024-04-25T10:39:06.408308+0000","last_fullsized":"2024-04-25T10:39:06.408308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804664+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T10:39:23.804664+0000","last_peered":"2024-04-25T10:39:23.804664+0000","last_clean":"2024-04-25T10:39:23.804664+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T10:39:23.804664+0000","last_undegraded":"2024-04-25T10:39:23.804664+0000","last_fullsized":"2024-04-25T10:39:23.804664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409798+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T10:39:06.409798+0000","last_peered":"2024-04-25T10:39:06.409798+0000","last_clean":"2024-04-25T10:39:06.409798+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T10:39:06.409798+0000","last_undegraded":"2024-04-25T10:39:06.409798+0000","last_fullsized":"2024-04-25T10:39:06.409798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372078+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T10:39:06.372078+0000","last_peered":"2024-04-25T10:39:06.372078+0000","last_clean":"2024-04-25T10:39:06.372078+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T10:39:06.372078+0000","last_undegraded":"2024-04-25T10:39:06.372078+0000","last_fullsized":"2024-04-25T10:39:06.372078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808734+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T10:39:23.808734+0000","last_peered":"2024-04-25T10:39:23.808734+0000","last_clean":"2024-04-25T10:39:23.808734+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T10:39:23.808734+0000","last_undegraded":"2024-04-25T10:39:23.808734+0000","last_fullsized":"2024-04-25T10:39:23.808734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408232+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T10:39:06.408232+0000","last_peered":"2024-04-25T10:39:06.408232+0000","last_clean":"2024-04-25T10:39:06.408232+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T10:39:06.408232+0000","last_undegraded":"2024-04-25T10:39:06.408232+0000","last_fullsized":"2024-04-25T10:39:06.408232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376780+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T10:39:05.376780+0000","last_peered":"2024-04-25T10:39:05.376780+0000","last_clean":"2024-04-25T10:39:05.376780+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T10:39:05.376780+0000","last_undegraded":"2024-04-25T10:39:05.376780+0000","last_fullsized":"2024-04-25T10:39:05.376780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811522+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T10:39:24.811522+0000","last_peered":"2024-04-25T10:39:24.811522+0000","last_clean":"2024-04-25T10:39:24.811522+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T10:39:24.811522+0000","last_undegraded":"2024-04-25T10:39:24.811522+0000","last_fullsized":"2024-04-25T10:39:24.811522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375180+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T10:39:05.375180+0000","last_peered":"2024-04-25T10:39:05.375180+0000","last_clean":"2024-04-25T10:39:05.375180+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T10:39:05.375180+0000","last_undegraded":"2024-04-25T10:39:05.375180+0000","last_fullsized":"2024-04-25T10:39:05.375180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450786+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T10:39:06.450786+0000","last_peered":"2024-04-25T10:39:06.450786+0000","last_clean":"2024-04-25T10:39:06.450786+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T10:39:06.450786+0000","last_undegraded":"2024-04-25T10:39:06.450786+0000","last_fullsized":"2024-04-25T10:39:06.450786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263127+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T10:39:06.263127+0000","last_peered":"2024-04-25T10:39:06.263127+0000","last_clean":"2024-04-25T10:39:06.263127+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T10:39:06.263127+0000","last_undegraded":"2024-04-25T10:39:06.263127+0000","last_fullsized":"2024-04-25T10:39:06.263127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371458+0000","last_change":"2024-04-25T10:39:04.075522+0000","last_active":"2024-04-25T10:39:06.371458+0000","last_peered":"2024-04-25T10:39:06.371458+0000","last_clean":"2024-04-25T10:39:06.371458+0000","last_became_active":"2024-04-25T10:39:04.074914+0000","last_became_peered":"2024-04-25T10:39:04.074914+0000","last_unstale":"2024-04-25T10:39:06.371458+0000","last_undegraded":"2024-04-25T10:39:06.371458+0000","last_fullsized":"2024-04-25T10:39:06.371458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381205+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T10:39:05.381205+0000","last_peered":"2024-04-25T10:39:05.381205+0000","last_clean":"2024-04-25T10:39:05.381205+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T10:39:05.381205+0000","last_undegraded":"2024-04-25T10:39:05.381205+0000","last_fullsized":"2024-04-25T10:39:05.381205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450880+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T10:39:06.450880+0000","last_peered":"2024-04-25T10:39:06.450880+0000","last_clean":"2024-04-25T10:39:06.450880+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T10:39:06.450880+0000","last_undegraded":"2024-04-25T10:39:06.450880+0000","last_fullsized":"2024-04-25T10:39:06.450880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450432+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T10:39:06.450432+0000","last_peered":"2024-04-25T10:39:06.450432+0000","last_clean":"2024-04-25T10:39:06.450432+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T10:39:06.450432+0000","last_undegraded":"2024-04-25T10:39:06.450432+0000","last_fullsized":"2024-04-25T10:39:06.450432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409748+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T10:39:06.409748+0000","last_peered":"2024-04-25T10:39:06.409748+0000","last_clean":"2024-04-25T10:39:06.409748+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T10:39:06.409748+0000","last_undegraded":"2024-04-25T10:39:06.409748+0000","last_fullsized":"2024-04-25T10:39:06.409748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381353+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T10:39:05.381353+0000","last_peered":"2024-04-25T10:39:05.381353+0000","last_clean":"2024-04-25T10:39:05.381353+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T10:39:05.381353+0000","last_undegraded":"2024-04-25T10:39:05.381353+0000","last_fullsized":"2024-04-25T10:39:05.381353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450864+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T10:39:06.450864+0000","last_peered":"2024-04-25T10:39:06.450864+0000","last_clean":"2024-04-25T10:39:06.450864+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T10:39:06.450864+0000","last_undegraded":"2024-04-25T10:39:06.450864+0000","last_fullsized":"2024-04-25T10:39:06.450864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450419+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T10:39:06.450419+0000","last_peered":"2024-04-25T10:39:06.450419+0000","last_clean":"2024-04-25T10:39:06.450419+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T10:39:06.450419+0000","last_undegraded":"2024-04-25T10:39:06.450419+0000","last_fullsized":"2024-04-25T10:39:06.450419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812672+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T10:39:24.812672+0000","last_peered":"2024-04-25T10:39:24.812672+0000","last_clean":"2024-04-25T10:39:24.812672+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T10:39:24.812672+0000","last_undegraded":"2024-04-25T10:39:24.812672+0000","last_fullsized":"2024-04-25T10:39:24.812672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451427+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T10:39:06.451427+0000","last_peered":"2024-04-25T10:39:06.451427+0000","last_clean":"2024-04-25T10:39:06.451427+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T10:39:06.451427+0000","last_undegraded":"2024-04-25T10:39:06.451427+0000","last_fullsized":"2024-04-25T10:39:06.451427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371193+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T10:39:06.371193+0000","last_peered":"2024-04-25T10:39:06.371193+0000","last_clean":"2024-04-25T10:39:06.371193+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T10:39:06.371193+0000","last_undegraded":"2024-04-25T10:39:06.371193+0000","last_fullsized":"2024-04-25T10:39:06.371193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811354+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T10:39:24.811354+0000","last_peered":"2024-04-25T10:39:24.811354+0000","last_clean":"2024-04-25T10:39:24.811354+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T10:39:24.811354+0000","last_undegraded":"2024-04-25T10:39:24.811354+0000","last_fullsized":"2024-04-25T10:39:24.811354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372014+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T10:39:06.372014+0000","last_peered":"2024-04-25T10:39:06.372014+0000","last_clean":"2024-04-25T10:39:06.372014+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T10:39:06.372014+0000","last_undegraded":"2024-04-25T10:39:06.372014+0000","last_fullsized":"2024-04-25T10:39:06.372014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376170+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T10:39:05.376170+0000","last_peered":"2024-04-25T10:39:05.376170+0000","last_clean":"2024-04-25T10:39:05.376170+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T10:39:05.376170+0000","last_undegraded":"2024-04-25T10:39:05.376170+0000","last_fullsized":"2024-04-25T10:39:05.376170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.806571+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T10:39:23.806571+0000","last_peered":"2024-04-25T10:39:23.806571+0000","last_clean":"2024-04-25T10:39:23.806571+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T10:39:23.806571+0000","last_undegraded":"2024-04-25T10:39:23.806571+0000","last_fullsized":"2024-04-25T10:39:23.806571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261513+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T10:39:06.261513+0000","last_peered":"2024-04-25T10:39:06.261513+0000","last_clean":"2024-04-25T10:39:06.261513+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T10:39:06.261513+0000","last_undegraded":"2024-04-25T10:39:06.261513+0000","last_fullsized":"2024-04-25T10:39:06.261513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383275+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T10:39:05.383275+0000","last_peered":"2024-04-25T10:39:05.383275+0000","last_clean":"2024-04-25T10:39:05.383275+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T10:39:05.383275+0000","last_undegraded":"2024-04-25T10:39:05.383275+0000","last_fullsized":"2024-04-25T10:39:05.383275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261803+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T10:39:06.261803+0000","last_peered":"2024-04-25T10:39:06.261803+0000","last_clean":"2024-04-25T10:39:06.261803+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T10:39:06.261803+0000","last_undegraded":"2024-04-25T10:39:06.261803+0000","last_fullsized":"2024-04-25T10:39:06.261803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812418+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T10:39:24.812418+0000","last_peered":"2024-04-25T10:39:24.812418+0000","last_clean":"2024-04-25T10:39:24.812418+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T10:39:24.812418+0000","last_undegraded":"2024-04-25T10:39:24.812418+0000","last_fullsized":"2024-04-25T10:39:24.812418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379226+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T10:39:05.379226+0000","last_peered":"2024-04-25T10:39:05.379226+0000","last_clean":"2024-04-25T10:39:05.379226+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T10:39:05.379226+0000","last_undegraded":"2024-04-25T10:39:05.379226+0000","last_fullsized":"2024-04-25T10:39:05.379226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382589+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T10:39:05.382589+0000","last_peered":"2024-04-25T10:39:05.382589+0000","last_clean":"2024-04-25T10:39:05.382589+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T10:39:05.382589+0000","last_undegraded":"2024-04-25T10:39:05.382589+0000","last_fullsized":"2024-04-25T10:39:05.382589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450997+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T10:39:06.450997+0000","last_peered":"2024-04-25T10:39:06.450997+0000","last_clean":"2024-04-25T10:39:06.450997+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T10:39:06.450997+0000","last_undegraded":"2024-04-25T10:39:06.450997+0000","last_fullsized":"2024-04-25T10:39:06.450997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371805+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T10:39:06.371805+0000","last_peered":"2024-04-25T10:39:06.371805+0000","last_clean":"2024-04-25T10:39:06.371805+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T10:39:06.371805+0000","last_undegraded":"2024-04-25T10:39:06.371805+0000","last_fullsized":"2024-04-25T10:39:06.371805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263444+0000","last_change":"2024-04-25T10:38:59.376270+0000","last_active":"2024-04-25T10:39:06.263444+0000","last_peered":"2024-04-25T10:39:06.263444+0000","last_clean":"2024-04-25T10:39:06.263444+0000","last_became_active":"2024-04-25T10:38:59.375839+0000","last_became_peered":"2024-04-25T10:38:59.375839+0000","last_unstale":"2024-04-25T10:39:06.263444+0000","last_undegraded":"2024-04-25T10:39:06.263444+0000","last_fullsized":"2024-04-25T10:39:06.263444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:43.103655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407337+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T10:39:06.407337+0000","last_peered":"2024-04-25T10:39:06.407337+0000","last_clean":"2024-04-25T10:39:06.407337+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T10:39:06.407337+0000","last_undegraded":"2024-04-25T10:39:06.407337+0000","last_fullsized":"2024-04-25T10:39:06.407337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378738+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T10:39:05.378738+0000","last_peered":"2024-04-25T10:39:05.378738+0000","last_clean":"2024-04-25T10:39:05.378738+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T10:39:05.378738+0000","last_undegraded":"2024-04-25T10:39:05.378738+0000","last_fullsized":"2024-04-25T10:39:05.378738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262545+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T10:39:06.262545+0000","last_peered":"2024-04-25T10:39:06.262545+0000","last_clean":"2024-04-25T10:39:06.262545+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T10:39:06.262545+0000","last_undegraded":"2024-04-25T10:39:06.262545+0000","last_fullsized":"2024-04-25T10:39:06.262545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.410225+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T10:39:06.410225+0000","last_peered":"2024-04-25T10:39:06.410225+0000","last_clean":"2024-04-25T10:39:06.410225+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T10:39:06.410225+0000","last_undegraded":"2024-04-25T10:39:06.410225+0000","last_fullsized":"2024-04-25T10:39:06.410225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407296+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T10:39:06.407296+0000","last_peered":"2024-04-25T10:39:06.407296+0000","last_clean":"2024-04-25T10:39:06.407296+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T10:39:06.407296+0000","last_undegraded":"2024-04-25T10:39:06.407296+0000","last_fullsized":"2024-04-25T10:39:06.407296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263350+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T10:39:06.263350+0000","last_peered":"2024-04-25T10:39:06.263350+0000","last_clean":"2024-04-25T10:39:06.263350+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T10:39:06.263350+0000","last_undegraded":"2024-04-25T10:39:06.263350+0000","last_fullsized":"2024-04-25T10:39:06.263350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813380+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T10:39:24.813380+0000","last_peered":"2024-04-25T10:39:24.813380+0000","last_clean":"2024-04-25T10:39:24.813380+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T10:39:24.813380+0000","last_undegraded":"2024-04-25T10:39:24.813380+0000","last_fullsized":"2024-04-25T10:39:24.813380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371797+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T10:39:06.371797+0000","last_peered":"2024-04-25T10:39:06.371797+0000","last_clean":"2024-04-25T10:39:06.371797+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T10:39:06.371797+0000","last_undegraded":"2024-04-25T10:39:06.371797+0000","last_fullsized":"2024-04-25T10:39:06.371797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379998+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T10:39:05.379998+0000","last_peered":"2024-04-25T10:39:05.379998+0000","last_clean":"2024-04-25T10:39:05.379998+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T10:39:05.379998+0000","last_undegraded":"2024-04-25T10:39:05.379998+0000","last_fullsized":"2024-04-25T10:39:05.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812430+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T10:39:24.812430+0000","last_peered":"2024-04-25T10:39:24.812430+0000","last_clean":"2024-04-25T10:39:24.812430+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T10:39:24.812430+0000","last_undegraded":"2024-04-25T10:39:24.812430+0000","last_fullsized":"2024-04-25T10:39:24.812430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376592+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T10:39:05.376592+0000","last_peered":"2024-04-25T10:39:05.376592+0000","last_clean":"2024-04-25T10:39:05.376592+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T10:39:05.376592+0000","last_undegraded":"2024-04-25T10:39:05.376592+0000","last_fullsized":"2024-04-25T10:39:05.376592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262028+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T10:39:06.262028+0000","last_peered":"2024-04-25T10:39:06.262028+0000","last_clean":"2024-04-25T10:39:06.262028+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T10:39:06.262028+0000","last_undegraded":"2024-04-25T10:39:06.262028+0000","last_fullsized":"2024-04-25T10:39:06.262028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804398+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T10:39:23.804398+0000","last_peered":"2024-04-25T10:39:23.804398+0000","last_clean":"2024-04-25T10:39:23.804398+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T10:39:23.804398+0000","last_undegraded":"2024-04-25T10:39:23.804398+0000","last_fullsized":"2024-04-25T10:39:23.804398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376022+0000","last_change":"2024-04-25T10:39:04.075730+0000","last_active":"2024-04-25T10:39:05.376022+0000","last_peered":"2024-04-25T10:39:05.376022+0000","last_clean":"2024-04-25T10:39:05.376022+0000","last_became_active":"2024-04-25T10:39:04.074100+0000","last_became_peered":"2024-04-25T10:39:04.074100+0000","last_unstale":"2024-04-25T10:39:05.376022+0000","last_undegraded":"2024-04-25T10:39:05.376022+0000","last_fullsized":"2024-04-25T10:39:05.376022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371541+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T10:39:06.371541+0000","last_peered":"2024-04-25T10:39:06.371541+0000","last_clean":"2024-04-25T10:39:06.371541+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T10:39:06.371541+0000","last_undegraded":"2024-04-25T10:39:06.371541+0000","last_fullsized":"2024-04-25T10:39:06.371541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813673+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T10:39:24.813673+0000","last_peered":"2024-04-25T10:39:24.813673+0000","last_clean":"2024-04-25T10:39:24.813673+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T10:39:24.813673+0000","last_undegraded":"2024-04-25T10:39:24.813673+0000","last_fullsized":"2024-04-25T10:39:24.813673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380495+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T10:39:05.380495+0000","last_peered":"2024-04-25T10:39:05.380495+0000","last_clean":"2024-04-25T10:39:05.380495+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T10:39:05.380495+0000","last_undegraded":"2024-04-25T10:39:05.380495+0000","last_fullsized":"2024-04-25T10:39:05.380495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261538+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T10:39:06.261538+0000","last_peered":"2024-04-25T10:39:06.261538+0000","last_clean":"2024-04-25T10:39:06.261538+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T10:39:06.261538+0000","last_undegraded":"2024-04-25T10:39:06.261538+0000","last_fullsized":"2024-04-25T10:39:06.261538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.801119+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T10:39:23.801119+0000","last_peered":"2024-04-25T10:39:23.801119+0000","last_clean":"2024-04-25T10:39:23.801119+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T10:39:23.801119+0000","last_undegraded":"2024-04-25T10:39:23.801119+0000","last_fullsized":"2024-04-25T10:39:23.801119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450574+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T10:39:06.450574+0000","last_peered":"2024-04-25T10:39:06.450574+0000","last_clean":"2024-04-25T10:39:06.450574+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T10:39:06.450574+0000","last_undegraded":"2024-04-25T10:39:06.450574+0000","last_fullsized":"2024-04-25T10:39:06.450574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409684+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T10:39:06.409684+0000","last_peered":"2024-04-25T10:39:06.409684+0000","last_clean":"2024-04-25T10:39:06.409684+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T10:39:06.409684+0000","last_undegraded":"2024-04-25T10:39:06.409684+0000","last_fullsized":"2024-04-25T10:39:06.409684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450019+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T10:39:06.450019+0000","last_peered":"2024-04-25T10:39:06.450019+0000","last_clean":"2024-04-25T10:39:06.450019+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T10:39:06.450019+0000","last_undegraded":"2024-04-25T10:39:06.450019+0000","last_fullsized":"2024-04-25T10:39:06.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409205+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T10:39:06.409205+0000","last_peered":"2024-04-25T10:39:06.409205+0000","last_clean":"2024-04-25T10:39:06.409205+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T10:39:06.409205+0000","last_undegraded":"2024-04-25T10:39:06.409205+0000","last_fullsized":"2024-04-25T10:39:06.409205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372045+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T10:39:06.372045+0000","last_peered":"2024-04-25T10:39:06.372045+0000","last_clean":"2024-04-25T10:39:06.372045+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T10:39:06.372045+0000","last_undegraded":"2024-04-25T10:39:06.372045+0000","last_fullsized":"2024-04-25T10:39:06.372045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807641+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T10:39:23.807641+0000","last_peered":"2024-04-25T10:39:23.807641+0000","last_clean":"2024-04-25T10:39:23.807641+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T10:39:23.807641+0000","last_undegraded":"2024-04-25T10:39:23.807641+0000","last_fullsized":"2024-04-25T10:39:23.807641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375418+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T10:39:05.375418+0000","last_peered":"2024-04-25T10:39:05.375418+0000","last_clean":"2024-04-25T10:39:05.375418+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T10:39:05.375418+0000","last_undegraded":"2024-04-25T10:39:05.375418+0000","last_fullsized":"2024-04-25T10:39:05.375418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382417+0000","last_change":"2024-04-25T10:38:59.353750+0000","last_active":"2024-04-25T10:39:05.382417+0000","last_peered":"2024-04-25T10:39:05.382417+0000","last_clean":"2024-04-25T10:39:05.382417+0000","last_became_active":"2024-04-25T10:38:59.353056+0000","last_became_peered":"2024-04-25T10:38:59.353056+0000","last_unstale":"2024-04-25T10:39:05.382417+0000","last_undegraded":"2024-04-25T10:39:05.382417+0000","last_fullsized":"2024-04-25T10:39:05.382417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808876+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T10:39:23.808876+0000","last_peered":"2024-04-25T10:39:23.808876+0000","last_clean":"2024-04-25T10:39:23.808876+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T10:39:23.808876+0000","last_undegraded":"2024-04-25T10:39:23.808876+0000","last_fullsized":"2024-04-25T10:39:23.808876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375377+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T10:39:05.375377+0000","last_peered":"2024-04-25T10:39:05.375377+0000","last_clean":"2024-04-25T10:39:05.375377+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T10:39:05.375377+0000","last_undegraded":"2024-04-25T10:39:05.375377+0000","last_fullsized":"2024-04-25T10:39:05.375377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371727+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T10:39:06.371727+0000","last_peered":"2024-04-25T10:39:06.371727+0000","last_clean":"2024-04-25T10:39:06.371727+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T10:39:06.371727+0000","last_undegraded":"2024-04-25T10:39:06.371727+0000","last_fullsized":"2024-04-25T10:39:06.371727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450212+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T10:39:06.450212+0000","last_peered":"2024-04-25T10:39:06.450212+0000","last_clean":"2024-04-25T10:39:06.450212+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T10:39:06.450212+0000","last_undegraded":"2024-04-25T10:39:06.450212+0000","last_fullsized":"2024-04-25T10:39:06.450212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381633+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T10:39:05.381633+0000","last_peered":"2024-04-25T10:39:05.381633+0000","last_clean":"2024-04-25T10:39:05.381633+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T10:39:05.381633+0000","last_undegraded":"2024-04-25T10:39:05.381633+0000","last_fullsized":"2024-04-25T10:39:05.381633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383599+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T10:39:05.383599+0000","last_peered":"2024-04-25T10:39:05.383599+0000","last_clean":"2024-04-25T10:39:05.383599+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T10:39:05.383599+0000","last_undegraded":"2024-04-25T10:39:05.383599+0000","last_fullsized":"2024-04-25T10:39:05.383599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375402+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T10:39:05.375402+0000","last_peered":"2024-04-25T10:39:05.375402+0000","last_clean":"2024-04-25T10:39:05.375402+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T10:39:05.375402+0000","last_undegraded":"2024-04-25T10:39:05.375402+0000","last_fullsized":"2024-04-25T10:39:05.375402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812861+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T10:39:24.812861+0000","last_peered":"2024-04-25T10:39:24.812861+0000","last_clean":"2024-04-25T10:39:24.812861+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T10:39:24.812861+0000","last_undegraded":"2024-04-25T10:39:24.812861+0000","last_fullsized":"2024-04-25T10:39:24.812861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811253+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T10:39:24.811253+0000","last_peered":"2024-04-25T10:39:24.811253+0000","last_clean":"2024-04-25T10:39:24.811253+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T10:39:24.811253+0000","last_undegraded":"2024-04-25T10:39:24.811253+0000","last_fullsized":"2024-04-25T10:39:24.811253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371915+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T10:39:06.371915+0000","last_peered":"2024-04-25T10:39:06.371915+0000","last_clean":"2024-04-25T10:39:06.371915+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T10:39:06.371915+0000","last_undegraded":"2024-04-25T10:39:06.371915+0000","last_fullsized":"2024-04-25T10:39:06.371915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407786+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T10:39:06.407786+0000","last_peered":"2024-04-25T10:39:06.407786+0000","last_clean":"2024-04-25T10:39:06.407786+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T10:39:06.407786+0000","last_undegraded":"2024-04-25T10:39:06.407786+0000","last_fullsized":"2024-04-25T10:39:06.407786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.810784+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T10:39:23.810784+0000","last_peered":"2024-04-25T10:39:23.810784+0000","last_clean":"2024-04-25T10:39:23.810784+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T10:39:23.810784+0000","last_undegraded":"2024-04-25T10:39:23.810784+0000","last_fullsized":"2024-04-25T10:39:23.810784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408790+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T10:39:06.408790+0000","last_peered":"2024-04-25T10:39:06.408790+0000","last_clean":"2024-04-25T10:39:06.408790+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T10:39:06.408790+0000","last_undegraded":"2024-04-25T10:39:06.408790+0000","last_fullsized":"2024-04-25T10:39:06.408790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376153+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T10:39:05.376153+0000","last_peered":"2024-04-25T10:39:05.376153+0000","last_clean":"2024-04-25T10:39:05.376153+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T10:39:05.376153+0000","last_undegraded":"2024-04-25T10:39:05.376153+0000","last_fullsized":"2024-04-25T10:39:05.376153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379483+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T10:39:05.379483+0000","last_peered":"2024-04-25T10:39:05.379483+0000","last_clean":"2024-04-25T10:39:05.379483+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T10:39:05.379483+0000","last_undegraded":"2024-04-25T10:39:05.379483+0000","last_fullsized":"2024-04-25T10:39:05.379483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407574+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T10:39:06.407574+0000","last_peered":"2024-04-25T10:39:06.407574+0000","last_clean":"2024-04-25T10:39:06.407574+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T10:39:06.407574+0000","last_undegraded":"2024-04-25T10:39:06.407574+0000","last_fullsized":"2024-04-25T10:39:06.407574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380900+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T10:39:05.380900+0000","last_peered":"2024-04-25T10:39:05.380900+0000","last_clean":"2024-04-25T10:39:05.380900+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T10:39:05.380900+0000","last_undegraded":"2024-04-25T10:39:05.380900+0000","last_fullsized":"2024-04-25T10:39:05.380900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371754+0000","last_change":"2024-04-25T10:38:59.335488+0000","last_active":"2024-04-25T10:39:06.371754+0000","last_peered":"2024-04-25T10:39:06.371754+0000","last_clean":"2024-04-25T10:39:06.371754+0000","last_became_active":"2024-04-25T10:38:59.335116+0000","last_became_peered":"2024-04-25T10:38:59.335116+0000","last_unstale":"2024-04-25T10:39:06.371754+0000","last_undegraded":"2024-04-25T10:39:06.371754+0000","last_fullsized":"2024-04-25T10:39:06.371754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376240+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T10:39:05.376240+0000","last_peered":"2024-04-25T10:39:05.376240+0000","last_clean":"2024-04-25T10:39:05.376240+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T10:39:05.376240+0000","last_undegraded":"2024-04-25T10:39:05.376240+0000","last_fullsized":"2024-04-25T10:39:05.376240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450833+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T10:39:06.450833+0000","last_peered":"2024-04-25T10:39:06.450833+0000","last_clean":"2024-04-25T10:39:06.450833+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T10:39:06.450833+0000","last_undegraded":"2024-04-25T10:39:06.450833+0000","last_fullsized":"2024-04-25T10:39:06.450833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384578+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T10:39:05.384578+0000","last_peered":"2024-04-25T10:39:05.384578+0000","last_clean":"2024-04-25T10:39:05.384578+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T10:39:05.384578+0000","last_undegraded":"2024-04-25T10:39:05.384578+0000","last_fullsized":"2024-04-25T10:39:05.384578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376701+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T10:39:05.376701+0000","last_peered":"2024-04-25T10:39:05.376701+0000","last_clean":"2024-04-25T10:39:05.376701+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T10:39:05.376701+0000","last_undegraded":"2024-04-25T10:39:05.376701+0000","last_fullsized":"2024-04-25T10:39:05.376701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379166+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T10:39:05.379166+0000","last_peered":"2024-04-25T10:39:05.379166+0000","last_clean":"2024-04-25T10:39:05.379166+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T10:39:05.379166+0000","last_undegraded":"2024-04-25T10:39:05.379166+0000","last_fullsized":"2024-04-25T10:39:05.379166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375532+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T10:39:05.375532+0000","last_peered":"2024-04-25T10:39:05.375532+0000","last_clean":"2024-04-25T10:39:05.375532+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T10:39:05.375532+0000","last_undegraded":"2024-04-25T10:39:05.375532+0000","last_fullsized":"2024-04-25T10:39:05.375532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380616+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T10:39:05.380616+0000","last_peered":"2024-04-25T10:39:05.380616+0000","last_clean":"2024-04-25T10:39:05.380616+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T10:39:05.380616+0000","last_undegraded":"2024-04-25T10:39:05.380616+0000","last_fullsized":"2024-04-25T10:39:05.380616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371579+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T10:39:06.371579+0000","last_peered":"2024-04-25T10:39:06.371579+0000","last_clean":"2024-04-25T10:39:06.371579+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T10:39:06.371579+0000","last_undegraded":"2024-04-25T10:39:06.371579+0000","last_fullsized":"2024-04-25T10:39:06.371579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384073+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T10:39:05.384073+0000","last_peered":"2024-04-25T10:39:05.384073+0000","last_clean":"2024-04-25T10:39:05.384073+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T10:39:05.384073+0000","last_undegraded":"2024-04-25T10:39:05.384073+0000","last_fullsized":"2024-04-25T10:39:05.384073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262884+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T10:39:06.262884+0000","last_peered":"2024-04-25T10:39:06.262884+0000","last_clean":"2024-04-25T10:39:06.262884+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T10:39:06.262884+0000","last_undegraded":"2024-04-25T10:39:06.262884+0000","last_fullsized":"2024-04-25T10:39:06.262884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407870+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T10:39:06.407870+0000","last_peered":"2024-04-25T10:39:06.407870+0000","last_clean":"2024-04-25T10:39:06.407870+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T10:39:06.407870+0000","last_undegraded":"2024-04-25T10:39:06.407870+0000","last_fullsized":"2024-04-25T10:39:06.407870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382695+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T10:39:05.382695+0000","last_peered":"2024-04-25T10:39:05.382695+0000","last_clean":"2024-04-25T10:39:05.382695+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T10:39:05.382695+0000","last_undegraded":"2024-04-25T10:39:05.382695+0000","last_fullsized":"2024-04-25T10:39:05.382695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378766+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T10:39:05.378766+0000","last_peered":"2024-04-25T10:39:05.378766+0000","last_clean":"2024-04-25T10:39:05.378766+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T10:39:05.378766+0000","last_undegraded":"2024-04-25T10:39:05.378766+0000","last_fullsized":"2024-04-25T10:39:05.378766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450284+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T10:39:06.450284+0000","last_peered":"2024-04-25T10:39:06.450284+0000","last_clean":"2024-04-25T10:39:06.450284+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T10:39:06.450284+0000","last_undegraded":"2024-04-25T10:39:06.450284+0000","last_fullsized":"2024-04-25T10:39:06.450284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371478+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T10:39:06.371478+0000","last_peered":"2024-04-25T10:39:06.371478+0000","last_clean":"2024-04-25T10:39:06.371478+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T10:39:06.371478+0000","last_undegraded":"2024-04-25T10:39:06.371478+0000","last_fullsized":"2024-04-25T10:39:06.371478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376036+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T10:39:05.376036+0000","last_peered":"2024-04-25T10:39:05.376036+0000","last_clean":"2024-04-25T10:39:05.376036+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T10:39:05.376036+0000","last_undegraded":"2024-04-25T10:39:05.376036+0000","last_fullsized":"2024-04-25T10:39:05.376036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409436+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T10:39:06.409436+0000","last_peered":"2024-04-25T10:39:06.409436+0000","last_clean":"2024-04-25T10:39:06.409436+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T10:39:06.409436+0000","last_undegraded":"2024-04-25T10:39:06.409436+0000","last_fullsized":"2024-04-25T10:39:06.409436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383406+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T10:39:05.383406+0000","last_peered":"2024-04-25T10:39:05.383406+0000","last_clean":"2024-04-25T10:39:05.383406+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T10:39:05.383406+0000","last_undegraded":"2024-04-25T10:39:05.383406+0000","last_fullsized":"2024-04-25T10:39:05.383406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384611+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T10:39:05.384611+0000","last_peered":"2024-04-25T10:39:05.384611+0000","last_clean":"2024-04-25T10:39:05.384611+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T10:39:05.384611+0000","last_undegraded":"2024-04-25T10:39:05.384611+0000","last_fullsized":"2024-04-25T10:39:05.384611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263214+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T10:39:06.263214+0000","last_peered":"2024-04-25T10:39:06.263214+0000","last_clean":"2024-04-25T10:39:06.263214+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T10:39:06.263214+0000","last_undegraded":"2024-04-25T10:39:06.263214+0000","last_fullsized":"2024-04-25T10:39:06.263214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375273+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T10:39:05.375273+0000","last_peered":"2024-04-25T10:39:05.375273+0000","last_clean":"2024-04-25T10:39:05.375273+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T10:39:05.375273+0000","last_undegraded":"2024-04-25T10:39:05.375273+0000","last_fullsized":"2024-04-25T10:39:05.375273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262803+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T10:39:06.262803+0000","last_peered":"2024-04-25T10:39:06.262803+0000","last_clean":"2024-04-25T10:39:06.262803+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T10:39:06.262803+0000","last_undegraded":"2024-04-25T10:39:06.262803+0000","last_fullsized":"2024-04-25T10:39:06.262803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380508+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T10:39:05.380508+0000","last_peered":"2024-04-25T10:39:05.380508+0000","last_clean":"2024-04-25T10:39:05.380508+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T10:39:05.380508+0000","last_undegraded":"2024-04-25T10:39:05.380508+0000","last_fullsized":"2024-04-25T10:39:05.380508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261606+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T10:39:06.261606+0000","last_peered":"2024-04-25T10:39:06.261606+0000","last_clean":"2024-04-25T10:39:06.261606+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T10:39:06.261606+0000","last_undegraded":"2024-04-25T10:39:06.261606+0000","last_fullsized":"2024-04-25T10:39:06.261606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382113+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T10:39:05.382113+0000","last_peered":"2024-04-25T10:39:05.382113+0000","last_clean":"2024-04-25T10:39:05.382113+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T10:39:05.382113+0000","last_undegraded":"2024-04-25T10:39:05.382113+0000","last_fullsized":"2024-04-25T10:39:05.382113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371520+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T10:39:06.371520+0000","last_peered":"2024-04-25T10:39:06.371520+0000","last_clean":"2024-04-25T10:39:06.371520+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T10:39:06.371520+0000","last_undegraded":"2024-04-25T10:39:06.371520+0000","last_fullsized":"2024-04-25T10:39:06.371520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451173+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T10:39:06.451173+0000","last_peered":"2024-04-25T10:39:06.451173+0000","last_clean":"2024-04-25T10:39:06.451173+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T10:39:06.451173+0000","last_undegraded":"2024-04-25T10:39:06.451173+0000","last_fullsized":"2024-04-25T10:39:06.451173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262865+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T10:39:06.262865+0000","last_peered":"2024-04-25T10:39:06.262865+0000","last_clean":"2024-04-25T10:39:06.262865+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T10:39:06.262865+0000","last_undegraded":"2024-04-25T10:39:06.262865+0000","last_fullsized":"2024-04-25T10:39:06.262865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":703748,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":112826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":116528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":112896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":703092,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:39:27.412 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:39:27.412 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T10:39:27.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T10:39:27.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T10:39:27.413 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T10:39:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.595+0000 7fd40da00640 1 Processor -- start 2024-04-25T10:39:27.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.595+0000 7fd40da00640 1 -- start start 2024-04-25T10:39:27.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd40da00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd40815b9d0 0x7fd4080c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd40da00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4080b8f60 con 0x7fd4080c97a0 2024-04-25T10:39:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd40da00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4080b9220 con 0x7fd4080c7c40 2024-04-25T10:39:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd40da00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd4080c9bb0 con 0x7fd40815b9d0 2024-04-25T10:39:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd407400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd4080c97a0 0x7fd4081658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38418/0 (socket says 172.21.15.16:38418) 2024-04-25T10:39:27.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd407400640 1 -- 172.21.15.16:0/198974861 learned_addr learned my addr 172.21.15.16:0/198974861 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 --2- 172.21.15.16:0/198974861 >> v2:172.21.15.186:3300/0 conn(0x7fd40815b9d0 0x7fd4080c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687033772 0 0) 0x7fd4080b8f60 con 0x7fd4080c97a0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3ec0035c0 con 0x7fd4080c97a0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 151636622 0 0) 0x7fd3ec0035c0 con 0x7fd4080c97a0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 >> v2:172.21.15.186:3300/0 conn(0x7fd40815b9d0 msgr2=0x7fd4080c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 --2- 172.21.15.16:0/198974861 >> v2:172.21.15.186:3300/0 conn(0x7fd40815b9d0 0x7fd4080c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 >> v1:172.21.15.186:6789/0 conn(0x7fd4080c7c40 legacy=0x7fd4080c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4080b9500 con 0x7fd4080c97a0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fd4000016d0 con 0x7fd4080c97a0 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 >> v1:172.21.15.16:6789/0 conn(0x7fd4080c97a0 legacy=0x7fd4081658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec003a50 0x7fd3ec003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 0x7fd3ec004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ec005310 0x7fd3ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec00c220 con 0x7fd3ec0048a0 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec00c3d0 con 0x7fd3ec005310 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ec00c5d0 con 0x7fd3ec003a50 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 0x7fd3ec004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd407400640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ec005310 0x7fd3ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd406a00640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec003a50 0x7fd3ec003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 -- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec003a50 msgr2=0x7fd3ec003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec003a50 0x7fd3ec003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 -- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ec005310 msgr2=0x7fd3ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ec005310 0x7fd3ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd3fe000640 1 -- 172.21.15.16:0/198974861 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec0035c0 con 0x7fd3ec0048a0 2024-04-25T10:39:27.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd407400640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3ec005310 0x7fd3ec00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:27.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.599+0000 7fd407400640 1 -- 172.21.15.16:0/198974861 reap_dead start 2024-04-25T10:39:27.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd3fe000640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 0x7fd3ec004cb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009b60 tx=0x7fd3f001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b00ac15e641c02e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0009730 con 0x7fd3ec0048a0 2024-04-25T10:39:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f00a64e0 con 0x7fd3ec0048a0 2024-04-25T10:39:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd406000640 1 -- 172.21.15.16:0/198974861 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00a68f0 con 0x7fd3ec0048a0 2024-04-25T10:39:27.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 -- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 msgr2=0x7fd3ec004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 0x7fd3ec004cb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009b60 tx=0x7fd3f001caf0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 -- 172.21.15.16:0/198974861 shutdown_connections 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 --2- 172.21.15.16:0/198974861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3ec0048a0 0x7fd3ec004cb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 -- 172.21.15.16:0/198974861 >> 172.21.15.16:0/198974861 conn(0x7fd4080cdc80 msgr2=0x7fd4080c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 -- 172.21.15.16:0/198974861 shutdown_connections 2024-04-25T10:39:27.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.603+0000 7fd40da00640 1 -- 172.21.15.16:0/198974861 wait complete. 2024-04-25T10:39:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 Processor -- start 2024-04-25T10:39:27.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 -- start start 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec0048a0 0x7fd40813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4081390c0 0x7fd4081558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd4080c8150 con 0x7fd40813e7d0 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd4080b9ac0 con 0x7fd4081390c0 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd40da00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd4080c82d0 con 0x7fd3ec0048a0 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46624/0 (socket says 172.21.15.16:46624) 2024-04-25T10:39:27.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd406a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec0048a0 0x7fd40813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 -- 172.21.15.16:0/952207806 learned_addr learned my addr 172.21.15.16:0/952207806 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:27.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd3fe000640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4081390c0 0x7fd4081558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 -- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec0048a0 msgr2=0x7fd40813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec0048a0 0x7fd40813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 -- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4081390c0 msgr2=0x7fd4081558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4081390c0 0x7fd4081558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.607+0000 7fd407400640 1 -- 172.21.15.16:0/952207806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4081fcd70 con 0x7fd40813e7d0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd407400640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4080ba040 tx=0x7fd40000e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400019070 con 0x7fd40813e7d0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000105d0 con 0x7fd40813e7d0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400010980 con 0x7fd40813e7d0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4081fd050 con 0x7fd40813e7d0 2024-04-25T10:39:27.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4081fd610 con 0x7fd40813e7d0 2024-04-25T10:39:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd408050750 con 0x7fd40813e7d0 2024-04-25T10:39:27.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd40001c070 con 0x7fd40813e7d0 2024-04-25T10:39:27.617 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 0x7fd3e0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:27.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.611+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd40008ea70 con 0x7fd40813e7d0 2024-04-25T10:39:27.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.615+0000 7fd406a00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 0x7fd3e0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:27.618 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.615+0000 7fd406a00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 0x7fd3e0071ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8001340 tx=0x7fd3f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:27.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.619+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd40005b070 con 0x7fd40813e7d0 2024-04-25T10:39:27.831 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.827+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd40806e1f0 con 0x7fd40813e7d0 2024-04-25T10:39:27.834 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd3ff400640 1 -- 172.21.15.16:0/952207806 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179551 (secure 0 0 0) 0x7fd40005f370 con 0x7fd40813e7d0 2024-04-25T10:39:27.836 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:27.837 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 msgr2=0x7fd3e0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 0x7fd3e0071ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8001340 tx=0x7fd3f8009040 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 msgr2=0x7fd4081ebef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4080ba040 tx=0x7fd40000e960 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 shutdown_connections 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd3e006f5a0 0x7fd3e0071ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40813e7d0 0x7fd4081ebef0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4081390c0 0x7fd4081558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 --2- 172.21.15.16:0/952207806 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd3ec0048a0 0x7fd40813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 >> 172.21.15.16:0/952207806 conn(0x7fd4080cdc80 msgr2=0x7fd408159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 shutdown_connections 2024-04-25T10:39:27.838 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:27.831+0000 7fd40da00640 1 -- 172.21.15.16:0/952207806 wait complete. 2024-04-25T10:39:27.858 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":4166069756},{"type":"v1","addr":"172.21.15.186:6833","nonce":4166069756}]},"active_addr":"172.21.15.186:6833/4166069756","active_change":"2024-04-25T10:38:37.632781+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":2491830793}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":3127764662}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":1108944613}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.186:0","nonce":478430356}]}]} 2024-04-25T10:39:27.861 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T10:39:27.862 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T10:39:27.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:28.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.007+0000 7fe348000640 1 Processor -- start 2024-04-25T10:39:28.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe348000640 1 -- start start 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe348000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe340155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe348000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34015e5f0 con 0x7fe3400c8a70 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe348000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34015e890 con 0x7fe3400ca830 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe348000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe340155640 con 0x7fe34015b960 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe344c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe3400c8a70 0x7fe3400ca120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38422/0 (socket says 172.21.15.16:38422) 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe344c00640 1 -- 172.21.15.16:0/2500210906 learned_addr learned my addr 172.21.15.16:0/2500210906 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:28.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe345600640 1 --2- 172.21.15.16:0/2500210906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe340155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854155565 0 0) 0x7fe34015e5f0 con 0x7fe3400c8a70 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3280035c0 con 0x7fe3400c8a70 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244442322 0 0) 0x7fe34015e890 con 0x7fe3400ca830 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe34015e5f0 con 0x7fe3400ca830 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe345600640 1 -- 172.21.15.16:0/2500210906 >> v1:172.21.15.186:6789/0 conn(0x7fe3400ca830 legacy=0x7fe3401657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe345600640 1 -- 172.21.15.16:0/2500210906 >> v1:172.21.15.16:6789/0 conn(0x7fe3400c8a70 legacy=0x7fe3400ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.011+0000 7fe345600640 1 -- 172.21.15.16:0/2500210906 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34015eb70 con 0x7fe34015b960 2024-04-25T10:39:28.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe345600640 1 --2- 172.21.15.16:0/2500210906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe340155100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe334009930 tx=0x7fe33401edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=121d8089554dd87b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3340b5070 con 0x7fe34015b960 2024-04-25T10:39:28.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3340a8ad0 con 0x7fe34015b960 2024-04-25T10:39:28.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe33fe00640 1 -- 172.21.15.16:0/2500210906 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3340b0440 con 0x7fe34015b960 2024-04-25T10:39:28.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 -- 172.21.15.16:0/2500210906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 msgr2=0x7fe340155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 --2- 172.21.15.16:0/2500210906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe340155100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe334009930 tx=0x7fe33401edd0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 -- 172.21.15.16:0/2500210906 shutdown_connections 2024-04-25T10:39:28.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 --2- 172.21.15.16:0/2500210906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe340155100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 -- 172.21.15.16:0/2500210906 >> 172.21.15.16:0/2500210906 conn(0x7fe340073180 msgr2=0x7fe340073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 -- 172.21.15.16:0/2500210906 shutdown_connections 2024-04-25T10:39:28.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.015+0000 7fe348000640 1 -- 172.21.15.16:0/2500210906 wait complete. 2024-04-25T10:39:28.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 Processor -- start 2024-04-25T10:39:28.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 -- start start 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3400ca830 0x7fe34014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe34014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe34015bd70 con 0x7fe3400c8a70 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe34015f130 con 0x7fe3400ca830 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe348000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe3400c9650 con 0x7fe34015b960 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe345600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe345600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46626/0 (socket says 172.21.15.16:46626) 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.019+0000 7fe345600640 1 -- 172.21.15.16:0/4020105258 learned_addr learned my addr 172.21.15.16:0/4020105258 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe344c00640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3400ca830 0x7fe34014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe346000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe34014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 -- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 msgr2=0x7fe34014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe34014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 -- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3400ca830 msgr2=0x7fe34014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3400ca830 0x7fe34014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 -- 172.21.15.16:0/4020105258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3401f99b0 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe345600640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b3040 tx=0x7fe33401bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3340c1070 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe334003820 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe340148fa0 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3340b5040 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3401f96d0 con 0x7fe3400c8a70 2024-04-25T10:39:28.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3401f94c0 con 0x7fe3400c8a70 2024-04-25T10:39:28.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.023+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe3340c4070 con 0x7fe3400c8a70 2024-04-25T10:39:28.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.027+0000 7fe33d600640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 0x7fe31c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.027+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe33412ccc0 con 0x7fe3400c8a70 2024-04-25T10:39:28.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.027+0000 7fe344c00640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 0x7fe31c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.027+0000 7fe344c00640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 0x7fe31c071ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe340149650 tx=0x7fe32c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.031+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe334133080 con 0x7fe3400c8a70 2024-04-25T10:39:28.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.199+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe34014cb00 con 0x7fe3400c8a70 2024-04-25T10:39:28.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe33d600640 1 -- 172.21.15.16:0/4020105258 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fe334018930 con 0x7fe3400c8a70 2024-04-25T10:39:28.207 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:28.207 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:28.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 msgr2=0x7fe31c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.209 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 0x7fe31c071ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe340149650 tx=0x7fe32c009040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 msgr2=0x7fe340148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe3340b3040 tx=0x7fe33401bb70 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 shutdown_connections 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe31c06f5a0 0x7fe31c071ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe34015b960 0x7fe34014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3400ca830 0x7fe34014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 --2- 172.21.15.16:0/4020105258 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3400c8a70 0x7fe340148a60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 >> 172.21.15.16:0/4020105258 conn(0x7fe340073180 msgr2=0x7fe3400c47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 shutdown_connections 2024-04-25T10:39:28.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.203+0000 7fe348000640 1 -- 172.21.15.16:0/4020105258 wait complete. 2024-04-25T10:39:28.230 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T10:39:28.230 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:28.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.375+0000 7fcdd4e00640 1 Processor -- start 2024-04-25T10:39:28.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.375+0000 7fcdd4e00640 1 -- start start 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdd4e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcdd00c9270 0x7fcdd00c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdd4e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd00c81d0 con 0x7fcdd015dd00 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdd4e00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd00c84b0 con 0x7fcdd00c9680 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdd4e00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd00c7f80 con 0x7fcdd00c9270 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcdd015dd00 0x7fcdd00ca790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38426/0 (socket says 172.21.15.16:38426) 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 -- 172.21.15.16:0/969820102 learned_addr learned my addr 172.21.15.16:0/969820102 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:28.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdc5400640 1 --2- 172.21.15.16:0/969820102 >> v2:172.21.15.186:3300/0 conn(0x7fcdd00c9270 0x7fcdd00c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710987268 0 0) 0x7fcdd00c81d0 con 0x7fcdd015dd00 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb40057d0 con 0x7fcdd015dd00 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273794584 0 0) 0x7fcdb40057d0 con 0x7fcdd015dd00 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 >> v2:172.21.15.186:3300/0 conn(0x7fcdd00c9270 msgr2=0x7fcdd00c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 --2- 172.21.15.16:0/969820102 >> v2:172.21.15.186:3300/0 conn(0x7fcdd00c9270 0x7fcdd00c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 >> v1:172.21.15.186:6789/0 conn(0x7fcdd00c9680 legacy=0x7fcdd01646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd00c8790 con 0x7fcdd015dd00 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fcdc00016d0 con 0x7fcdd015dd00 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 >> v1:172.21.15.16:6789/0 conn(0x7fcdd015dd00 legacy=0x7fcdd00ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 0x7fcdb4006090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4006ab0 0x7fcdb4006ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdb4007450 0x7fcdb400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00c7f80 con 0x7fcdb4005c60 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb400e3a0 con 0x7fcdb4007450 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb400e5a0 con 0x7fcdb4006ab0 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 0x7fcdb4006090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdc5400640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4006ab0 0x7fcdb4006ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 -- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4006ab0 msgr2=0x7fcdb4006ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4006ab0 0x7fcdb4006ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 -- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdb4007450 msgr2=0x7fcdb400dc70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:39:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdb4007450 0x7fcdb400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdce800640 1 -- 172.21.15.16:0/969820102 reap_dead start 2024-04-25T10:39:28.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.379+0000 7fcdcde00640 1 -- 172.21.15.16:0/969820102 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb40057d0 con 0x7fcdb4005c60 2024-04-25T10:39:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdcde00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 0x7fcdb4006090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c320 tx=0x7fcdc001f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25761f92c64dc192 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0007e20 con 0x7fcdb4005c60 2024-04-25T10:39:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc0005920 con 0x7fcdb4005c60 2024-04-25T10:39:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdcd400640 1 -- 172.21.15.16:0/969820102 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0005d50 con 0x7fcdb4005c60 2024-04-25T10:39:28.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 -- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 msgr2=0x7fcdb4006090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 0x7fcdb4006090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c320 tx=0x7fcdc001f4f0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 -- 172.21.15.16:0/969820102 shutdown_connections 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/969820102 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdb4005c60 0x7fcdb4006090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 -- 172.21.15.16:0/969820102 >> 172.21.15.16:0/969820102 conn(0x7fcdd00cdcf0 msgr2=0x7fcdd00ca080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 -- 172.21.15.16:0/969820102 shutdown_connections 2024-04-25T10:39:28.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.383+0000 7fcdd4e00640 1 -- 172.21.15.16:0/969820102 wait complete. 2024-04-25T10:39:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 Processor -- start 2024-04-25T10:39:28.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 -- start start 2024-04-25T10:39:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4005c60 0x7fcdd014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 0x7fcdd015c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00c1df0 con 0x7fcdd01524d0 2024-04-25T10:39:28.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00c8de0 con 0x7fcdd015af30 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdd4e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd0154460 con 0x7fcdb4005c60 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46644/0 (socket says 172.21.15.16:46644) 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 -- 172.21.15.16:0/1761067159 learned_addr learned my addr 172.21.15.16:0/1761067159 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdcde00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4005c60 0x7fcdd014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdc5400640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 0x7fcdd015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 -- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4005c60 msgr2=0x7fcdd014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4005c60 0x7fcdd014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 -- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 msgr2=0x7fcdd015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 0x7fcdd015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdce800640 1 -- 172.21.15.16:0/1761067159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd015ca50 con 0x7fcdd01524d0 2024-04-25T10:39:28.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.387+0000 7fcdc5400640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 0x7fcdd015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdce800640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdd015ade0 tx=0x7fcdc800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8017070 con 0x7fcdd01524d0 2024-04-25T10:39:28.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8005da0 con 0x7fcdd01524d0 2024-04-25T10:39:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800a850 con 0x7fcdd01524d0 2024-04-25T10:39:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd015b470 con 0x7fcdd01524d0 2024-04-25T10:39:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd015ba10 con 0x7fcdd01524d0 2024-04-25T10:39:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd0152ab0 con 0x7fcdd01524d0 2024-04-25T10:39:28.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcdc801a070 con 0x7fcdd01524d0 2024-04-25T10:39:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 0x7fcda8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.391+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcdc808ea10 con 0x7fcdd01524d0 2024-04-25T10:39:28.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.395+0000 7fcdcde00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 0x7fcda8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.395+0000 7fcdcde00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 0x7fcda8071ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ae000 tx=0x7fcdc0007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.395+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdc805ae90 con 0x7fcdd01524d0 2024-04-25T10:39:28.454 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T10:39:28.452+0000 7f947610d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-04-25T10:39:28.566 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdd015c060 con 0x7fcdd01524d0 2024-04-25T10:39:28.567 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdc6a00640 1 -- 172.21.15.16:0/1761067159 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fcdc805f190 con 0x7fcdd01524d0 2024-04-25T10:39:28.568 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:28.568 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 msgr2=0x7fcda8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 0x7fcda8071ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00ae000 tx=0x7fcdc0007040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 msgr2=0x7fcdd014e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdd015ade0 tx=0x7fcdc800cb90 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 shutdown_connections 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcda806f5a0 0x7fcda8071ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdd01524d0 0x7fcdd014e5c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdd015af30 0x7fcdd015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 --2- 172.21.15.16:0/1761067159 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdb4005c60 0x7fcdd014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.563+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 >> 172.21.15.16:0/1761067159 conn(0x7fcdd00cdcf0 msgr2=0x7fcdd00cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.567+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 shutdown_connections 2024-04-25T10:39:28.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.567+0000 7fcdd4e00640 1 -- 172.21.15.16:0/1761067159 wait complete. 2024-04-25T10:39:28.591 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T10:39:28.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T10:39:28.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T10:39:28.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T10:39:28.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T10:39:28.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T10:39:28.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T10:39:28.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T10:39:28.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.859+0000 7fafa0000640 1 Processor -- start 2024-04-25T10:39:28.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.859+0000 7fafa0000640 1 -- start start 2024-04-25T10:39:28.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 Processor -- start 2024-04-25T10:39:28.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 -- start start 2024-04-25T10:39:28.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7fafa0000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7fafa0000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faf98074270 0x7faf9806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7faf9cc00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faf981530e0 0x7faf9815cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38428/0 (socket says 172.21.15.16:38428) 2024-04-25T10:39:28.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7faf9d600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7faf9d600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46326/0 (socket says 172.21.15.16:46326) 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970073260 0x7f69701532b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f69700c7a10 0x7f697006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69700c7e20 con 0x7f6970158ed0 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f69700c8430 con 0x7f69700c7a10 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.863+0000 7f6977000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6970159380 con 0x7f6970073260 2024-04-25T10:39:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9cc00640 1 -- 172.21.15.16:0/3252361501 learned_addr learned my addr 172.21.15.16:0/3252361501 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f696f400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970073260 0x7f69701532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f69700c7a10 0x7f697006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f69700c7a10 0x7f697006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33230/0 (socket says 172.21.15.16:33230) 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 -- 172.21.15.16:0/712709034 learned_addr learned my addr 172.21.15.16:0/712709034 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7fafa0000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf98159380 con 0x7faf981530e0 2024-04-25T10:39:28.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7faf98159660 con 0x7faf98074270 2024-04-25T10:39:28.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 -- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970073260 msgr2=0x7f69701532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7faf98159940 con 0x7faf98158ed0 2024-04-25T10:39:28.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9e000640 1 --2- 172.21.15.16:0/3252361501 >> v2:172.21.15.186:3300/0 conn(0x7faf98074270 0x7faf9806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9d600640 1 -- 172.21.15.16:0/3252361501 >> v2:172.21.15.186:3300/0 conn(0x7faf98074270 msgr2=0x7faf9806efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9d600640 1 --2- 172.21.15.16:0/3252361501 >> v2:172.21.15.186:3300/0 conn(0x7faf98074270 0x7faf9806efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9d600640 1 -- 172.21.15.16:0/3252361501 >> v1:172.21.15.16:6789/0 conn(0x7faf981530e0 legacy=0x7faf9815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7faf9d600640 1 -- 172.21.15.16:0/3252361501 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf98159c20 con 0x7faf98158ed0 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 --2- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970073260 0x7f69701532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 -- 172.21.15.16:0/712709034 >> v1:172.21.15.186:6789/0 conn(0x7f6970158ed0 legacy=0x7f697015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f6975000640 1 -- 172.21.15.16:0/712709034 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970159660 con 0x7f69700c7a10 2024-04-25T10:39:28.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f3cdfe00640 1 Processor -- start 2024-04-25T10:39:28.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.867+0000 7f3cdfe00640 1 -- start start 2024-04-25T10:39:28.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 0x7f3ce015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ce015e390 0x7f3ce00c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7eff39000640 1 Processor -- start 2024-04-25T10:39:28.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce015b580 con 0x7f3ce01552a0 2024-04-25T10:39:28.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3ce00b1040 con 0x7f3ce015e390 2024-04-25T10:39:28.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdfe00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00b1320 con 0x7f3ce006c670 2024-04-25T10:39:28.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdf400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7eff39000640 1 -- start start 2024-04-25T10:39:28.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ce015e390 0x7f3ce00c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7faf9d600640 1 --2- 172.21.15.16:0/3252361501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf84009900 tx=0x7faf84027560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e39666b3c19ee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ce015e390 0x7f3ce00c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33246/0 (socket says 172.21.15.16:33246) 2024-04-25T10:39:28.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 -- 172.21.15.16:0/975266030 learned_addr learned my addr 172.21.15.16:0/975266030 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f6975000640 1 --2- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700c7a10 0x7f697006efb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69600099d0 tx=0x7f696001c6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2f0ddb0fb15737f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cdea00640 1 --2- 172.21.15.16:0/975266030 >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 0x7f3ce015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f696ea00640 1 -- 172.21.15.16:0/712709034 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69600b2070 con 0x7f69700c7a10 2024-04-25T10:39:28.878 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f696ea00640 1 -- 172.21.15.16:0/712709034 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69600ad680 con 0x7f69700c7a10 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f696ea00640 1 -- 172.21.15.16:0/712709034 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69600ada50 con 0x7f69700c7a10 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 -- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 msgr2=0x7f3ce006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 -- 172.21.15.16:0/975266030 >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 msgr2=0x7f3ce015ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/975266030 >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 0x7f3ce015ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f3cd7e00640 1 -- 172.21.15.16:0/975266030 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce015af30 con 0x7f3ce015e390 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f6977000640 1 -- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700c7a10 msgr2=0x7f697006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7f6977000640 1 --2- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700c7a10 0x7f697006efb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69600099d0 tx=0x7f696001c6c0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff39000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7eff3415b5b0 0x7eff340c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff39000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7eff34161d20 0x7eff340ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff39000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff34164930 con 0x7eff340ca140 2024-04-25T10:39:28.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff39000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7eff340caa90 con 0x7eff34161d20 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff33400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7eff3415b5b0 0x7eff340c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7faf97e00640 1 -- 172.21.15.16:0/3252361501 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840bc070 con 0x7faf98158ed0 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7faf97e00640 1 -- 172.21.15.16:0/3252361501 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf840b7600 con 0x7faf98158ed0 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.871+0000 7faf97e00640 1 -- 172.21.15.16:0/3252361501 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840b7a10 con 0x7faf98158ed0 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 msgr2=0x7faf980c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 --2- 172.21.15.16:0/3252361501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf84009900 tx=0x7faf84027560 comp rx=0 tx=0).stop 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 shutdown_connections 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 --2- 172.21.15.16:0/3252361501 >> v2:172.21.15.186:3300/0 conn(0x7faf98074270 0x7faf9806efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 --2- 172.21.15.16:0/3252361501 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf980c7a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 >> 172.21.15.16:0/3252361501 conn(0x7faf980c9b10 msgr2=0x7faf980c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 shutdown_connections 2024-04-25T10:39:28.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7fafa0000640 1 -- 172.21.15.16:0/3252361501 wait complete. 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cdea00640 1 --2- 172.21.15.16:0/975266030 >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 0x7f3ce015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cdf400640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff39000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7eff34164c10 con 0x7eff3415b5b0 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff33400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7eff3415b5b0 0x7eff340c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33260/0 (socket says 172.21.15.16:33260) 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff33400640 1 -- 172.21.15.16:0/3197251930 learned_addr learned my addr 172.21.15.16:0/3197251930 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff32a00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7eff340ca140 0x7eff34161610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45278/0 (socket says 172.21.15.16:45278) 2024-04-25T10:39:28.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 -- 172.21.15.16:0/712709034 shutdown_connections 2024-04-25T10:39:28.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 --2- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970073260 0x7f69701532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 --2- 172.21.15.16:0/712709034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69700c7a10 0x7f697006efb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 -- 172.21.15.16:0/712709034 >> 172.21.15.16:0/712709034 conn(0x7f69700c9b10 msgr2=0x7f69700c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 -- 172.21.15.16:0/712709034 shutdown_connections 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7fafa0000640 1 Processor -- start 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7fafa0000640 1 -- start start 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce00c91e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00721b0 tx=0x7f3cc801ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd8b52b7b5b6961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cde000640 1 -- 172.21.15.16:0/975266030 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80b5070 con 0x7f3ce015e390 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cde000640 1 -- 172.21.15.16:0/975266030 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc80a8b30 con 0x7f3ce015e390 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f3cde000640 1 -- 172.21.15.16:0/975266030 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80b0440 con 0x7f3ce015e390 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 -- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 msgr2=0x7f3ce00c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce00c91e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00721b0 tx=0x7f3cc801ee70 comp rx=0 tx=0).stop 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 -- 172.21.15.16:0/975266030 shutdown_connections 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 --2- 172.21.15.16:0/975266030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce00c91e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 --2- 172.21.15.16:0/975266030 >> v2:172.21.15.16:3300/0 conn(0x7f3ce01552a0 0x7f3ce015ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 -- 172.21.15.16:0/975266030 >> 172.21.15.16:0/975266030 conn(0x7f3ce00c9cf0 msgr2=0x7f3ce00ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 -- 172.21.15.16:0/975266030 shutdown_connections 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f3cdfe00640 1 -- 172.21.15.16:0/975266030 wait complete. 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff33e00640 1 --2- 172.21.15.16:0/3197251930 >> v2:172.21.15.16:3300/0 conn(0x7eff34161d20 0x7eff340ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431634545 0 0) 0x7eff34164930 con 0x7eff340ca140 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff140035c0 con 0x7eff340ca140 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 886556675 0 0) 0x7eff140035c0 con 0x7eff340ca140 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 >> v2:172.21.15.186:3300/0 conn(0x7eff3415b5b0 msgr2=0x7eff340c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 --2- 172.21.15.16:0/3197251930 >> v2:172.21.15.186:3300/0 conn(0x7eff3415b5b0 0x7eff340c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 >> v2:172.21.15.16:3300/0 conn(0x7eff34161d20 msgr2=0x7eff340ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 --2- 172.21.15.16:0/3197251930 >> v2:172.21.15.16:3300/0 conn(0x7eff34161d20 0x7eff340ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34164ef0 con 0x7eff340ca140 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7eff20001710 con 0x7eff340ca140 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33e00640 1 --2- 172.21.15.16:0/3197251930 >> v2:172.21.15.16:3300/0 conn(0x7eff34161d20 0x7eff340ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 >> v1:172.21.15.186:6789/0 conn(0x7eff340ca140 legacy=0x7eff34161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff14003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff140048a0 0x7eff14004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff140051f0 0x7eff1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff340caa90 con 0x7eff140048a0 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff34164c10 con 0x7eff140051f0 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7eff1400c190 con 0x7eff14003a50 2024-04-25T10:39:28.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.875+0000 7f6977000640 1 -- 172.21.15.16:0/712709034 wait complete. 2024-04-25T10:39:28.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff14003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33e00640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff140051f0 0x7eff1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff32a00640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff140048a0 0x7eff14004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7ff5d3800640 1 Processor -- start 2024-04-25T10:39:28.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7ff5d3800640 1 -- start start 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f6977000640 1 Processor -- start 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7f6977000640 1 -- start start 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 -- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff140051f0 msgr2=0x7eff1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff140051f0 0x7eff1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 -- 172.21.15.16:0/3197251930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff140048a0 msgr2=0x7eff14004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff140048a0 0x7eff14004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33400640 1 -- 172.21.15.16:0/3197251930 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff140035c0 con 0x7eff14003a50 2024-04-25T10:39:28.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.879+0000 7eff33e00640 1 -- 172.21.15.16:0/3197251930 reap_dead start 2024-04-25T10:39:28.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf98074270 0x7faf98149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 0x7faf982093f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf98146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7faf9815d410 con 0x7faf98074270 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7faf9815d290 con 0x7faf981530e0 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7faf981534f0 con 0x7faf98158ed0 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 0x7faf982093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 0x7faf982093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33284/0 (socket says 172.21.15.16:33284) 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 -- 172.21.15.16:0/3913567969 learned_addr learned my addr 172.21.15.16:0/3913567969 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9e000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf98146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f3cdfe00640 1 Processor -- start 2024-04-25T10:39:28.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9d600640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf98074270 0x7faf98149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 0x7f6970156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 0x7f6970208fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 -- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 msgr2=0x7faf98146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf98158ed0 0x7faf98146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 -- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf98074270 msgr2=0x7faf98149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf98074270 0x7faf98149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf981471c0 con 0x7faf981530e0 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d3800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d3800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5cc0cbf50 0x7ff5cc0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f3cdfe00640 1 -- start start 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f696fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 0x7f6970156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f696fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 0x7f6970156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33298/0 (socket says 172.21.15.16:33298) 2024-04-25T10:39:28.893 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d3800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5cc0c8f80 con 0x7ff5cc157410 2024-04-25T10:39:28.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d3800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc157820 con 0x7ff5cc0cbf50 2024-04-25T10:39:28.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d3800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff5cc0cc8a0 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f696f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 0x7f6970208fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f696f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 0x7f6970208fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46684/0 (socket says 172.21.15.16:46684) 2024-04-25T10:39:28.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf9cc00640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 0x7faf982093f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c480 tx=0x7faf8c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970158ed0 0x7f6970154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f697015d290 con 0x7f69700c7a10 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6970166970 con 0x7f6970073260 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f6977000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f697015d410 con 0x7f6970158ed0 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f696fe00640 1 -- 172.21.15.16:0/1097955924 learned_addr learned my addr 172.21.15.16:0/1097955924 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c017070 con 0x7faf981530e0 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c005d30 con 0x7faf981530e0 2024-04-25T10:39:28.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0072b0 con 0x7faf981530e0 2024-04-25T10:39:28.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33310/0 (socket says 172.21.15.16:33310) 2024-04-25T10:39:28.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 -- 172.21.15.16:0/3249555946 learned_addr learned my addr 172.21.15.16:0/3249555946 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d1800640 1 --2- 172.21.15.16:0/3249555946 >> v2:172.21.15.16:3300/0 conn(0x7ff5cc0cbf50 0x7ff5cc0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.896 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6975000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970158ed0 0x7f6970154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf98205680 con 0x7faf981530e0 2024-04-25T10:39:28.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf98205c40 con 0x7faf981530e0 2024-04-25T10:39:28.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7f3cdfe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ce01552a0 0x7f3ce014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.897 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f60d8400640 1 Processor -- start 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 -- 172.21.15.16:0/3249555946 >> v2:172.21.15.16:3300/0 conn(0x7ff5cc0cbf50 msgr2=0x7ff5cc0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 --2- 172.21.15.16:0/3249555946 >> v2:172.21.15.16:3300/0 conn(0x7ff5cc0cbf50 0x7ff5cc0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 -- 172.21.15.16:0/3249555946 >> v1:172.21.15.186:6789/0 conn(0x7ff5cc157410 legacy=0x7ff5cc08d440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.883+0000 7ff5d0e00640 1 -- 172.21.15.16:0/3249555946 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc1605d0 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff33400640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff14003ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff24009c30 tx=0x7eff2401cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd803f26079ae9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7fbc5c200640 1 Processor -- start 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf98076d30 con 0x7faf981530e0 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46400/0 (socket says 172.21.15.16:46400) 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 -- 172.21.15.16:0/2771089309 learned_addr learned my addr 172.21.15.16:0/2771089309 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdfe00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce01fe690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00c9720 con 0x7f3ce01552a0 2024-04-25T10:39:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce015e7a0 con 0x7f3ce015e390 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00b1600 con 0x7f3ce006c670 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 -- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970158ed0 msgr2=0x7f6970154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970158ed0 0x7f6970154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 -- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 msgr2=0x7f6970156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 0x7f6970156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6970150530 con 0x7f69700c7a10 2024-04-25T10:39:28.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7fbc5c200640 1 -- start start 2024-04-25T10:39:28.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6975000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6970158ed0 0x7f6970154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:28.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696fe00640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6970073260 0x7f6970156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:28.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f696f400640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 0x7f6970208fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69700cd040 tx=0x7f695c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdf400640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce01fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f60d8400640 1 -- start start 2024-04-25T10:39:28.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240b2070 con 0x7eff14003a50 2024-04-25T10:39:28.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff240a5750 con 0x7eff14003a50 2024-04-25T10:39:28.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff32000640 1 -- 172.21.15.16:0/3197251930 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24009800 con 0x7eff14003a50 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 -- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 msgr2=0x7f3ce01fe690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ce01552a0 0x7f3ce014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ce015e390 0x7f3ce01fe690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 -- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ce01552a0 msgr2=0x7f3ce014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ce01552a0 0x7f3ce014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01febd0 con 0x7f3ce006c670 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ce01552a0 0x7f3ce014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:28.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c017070 con 0x7f69700c7a10 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff39000640 1 -- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 msgr2=0x7eff14003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff39000640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff14003ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff24009c30 tx=0x7eff2401cb90 comp rx=0 tx=0).stop 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695c00c940 con 0x7f69700c7a10 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c00ccf0 con 0x7f69700c7a10 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff39000640 1 -- 172.21.15.16:0/3197251930 shutdown_connections 2024-04-25T10:39:28.904 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff39000640 1 --2- 172.21.15.16:0/3197251930 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff14003ec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7eff39000640 1 -- 172.21.15.16:0/3197251930 >> 172.21.15.16:0/3197251930 conn(0x7eff34071300 msgr2=0x7eff340717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f3cdea00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce015cc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c8e0 tx=0x7f3cd000cda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.887+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69701567d0 con 0x7f69700c7a10 2024-04-25T10:39:28.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6970148fe0 con 0x7f69700c7a10 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faf8c01a070 con 0x7faf981530e0 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7eff39000640 1 -- 172.21.15.16:0/3197251930 shutdown_connections 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7eff39000640 1 -- 172.21.15.16:0/3197251930 wait complete. 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d8400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60d00c9390 0x7f60d00708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d8400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 0x7f60d016bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d8400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60d00c97a0 con 0x7f60d0070e10 2024-04-25T10:39:28.906 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d8400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f60d0164cf0 con 0x7f60d00c9390 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d8400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f60d0161980 con 0x7f60d0165890 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc5c200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 0x7fbc540c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc58e00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbc54074370 0x7fbc540c1fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45294/0 (socket says 172.21.15.16:45294) 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc58e00640 1 -- 172.21.15.16:0/2132650145 learned_addr learned my addr 172.21.15.16:0/2132650145 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5415d210 con 0x7fbc540c26c0 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5415d4b0 con 0x7fbc54074370 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5415d790 con 0x7fbc5415a600 2024-04-25T10:39:28.907 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fae9e800640 1 Processor -- start 2024-04-25T10:39:28.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fae9e800640 1 -- start start 2024-04-25T10:39:28.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0015070 con 0x7f3ce006c670 2024-04-25T10:39:28.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd0007a30 con 0x7f3ce006c670 2024-04-25T10:39:28.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0007e00 con 0x7f3ce006c670 2024-04-25T10:39:28.908 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69300010c0 con 0x7f69700c7a10 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3cdfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce015dbc0 con 0x7f3ce006c670 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3cdfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce015d8e0 con 0x7f3ce006c670 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d5000640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f60d0070e10 0x7f60d0165180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45306/0 (socket says 172.21.15.16:45306) 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d5000640 1 -- 172.21.15.16:0/2058889488 learned_addr learned my addr 172.21.15.16:0/2058889488 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d6400640 1 --2- 172.21.15.16:0/2058889488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 0x7f60d016bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.909 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc59800640 1 --2- 172.21.15.16:0/2132650145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 0x7fbc540c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc53e00640 1 -- 172.21.15.16:0/2132650145 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681463426 0 0) 0x7fbc5415d4b0 con 0x7fbc54074370 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc53e00640 1 -- 172.21.15.16:0/2132650145 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc3c0035c0 con 0x7fbc54074370 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7faf7406f5d0 0x7faf74071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf8c08f420 con 0x7faf981530e0 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7faf74078ce0 0x7faf7407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf8c009eb0 con 0x7faf74078ce0 2024-04-25T10:39:28.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf8c08f7d0 con 0x7faf981530e0 2024-04-25T10:39:28.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d5a00640 1 --2- 172.21.15.16:0/2058889488 >> v2:172.21.15.16:3300/0 conn(0x7f60d00c9390 0x7f60d00708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7ff5d0e00640 1 --2- 172.21.15.16:0/3249555946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0d2670 tx=0x7ff5bc01edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e45878e7478d40c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc59800640 1 -- 172.21.15.16:0/2132650145 >> v1:172.21.15.186:6789/0 conn(0x7fbc54074370 legacy=0x7fbc540c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc59800640 1 -- 172.21.15.16:0/2132650145 >> v1:172.21.15.16:6789/0 conn(0x7fbc540c26c0 legacy=0x7fbc54164500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.911 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7fbc59800640 1 -- 172.21.15.16:0/2132650145 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5415da70 con 0x7fbc5415a600 2024-04-25T10:39:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7ff5cb400640 1 -- 172.21.15.16:0/3249555946 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b5070 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7ff5cb400640 1 -- 172.21.15.16:0/3249555946 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0a8af0 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7ff5cb400640 1 -- 172.21.15.16:0/3249555946 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b0440 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c98001110 con 0x7f3ce006c670 2024-04-25T10:39:28.912 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d6400640 1 -- 172.21.15.16:0/2058889488 >> v2:172.21.15.16:3300/0 conn(0x7f60d00c9390 msgr2=0x7f60d00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d6400640 1 --2- 172.21.15.16:0/2058889488 >> v2:172.21.15.16:3300/0 conn(0x7f60d00c9390 0x7f60d00708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d6400640 1 -- 172.21.15.16:0/2058889488 >> v1:172.21.15.186:6789/0 conn(0x7f60d0070e10 legacy=0x7f60d0165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7f60d6400640 1 -- 172.21.15.16:0/2058889488 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d0161c60 con 0x7f60d0165890 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.891+0000 7faf9d600640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7faf7406f5d0 0x7faf74071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7faf9e000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7faf74078ce0 0x7faf7407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 -- 172.21.15.16:0/3249555946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc0c89d0 msgr2=0x7ff5cc0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3249555946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0d2670 tx=0x7ff5bc01edf0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7faf9e000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7faf74078ce0 0x7faf7407b170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3cd0018070 con 0x7f3ce006c670 2024-04-25T10:39:28.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7eff39000640 1 Processor -- start 2024-04-25T10:39:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae9e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7faf9d600640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7faf7406f5d0 0x7faf74071ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf840b9000 tx=0x7faf840b2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7eff39000640 1 -- start start 2024-04-25T10:39:28.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae9e800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fae980cc3a0 0x7fae980c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae9e800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9815d1b0 con 0x7fae980c7390 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae9e800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fae9806ecf0 con 0x7fae980cc3a0 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae9e800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fae9806efd0 con 0x7fae9806d830 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae97400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 -- 172.21.15.16:0/3249555946 shutdown_connections 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3249555946 >> v2:172.21.15.16:3300/0 conn(0x7ff5cc0cbf50 0x7ff5cc0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3249555946 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc0cdab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 -- 172.21.15.16:0/3249555946 >> 172.21.15.16:0/3249555946 conn(0x7ff5cc0d19d0 msgr2=0x7ff5cc0d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 -- 172.21.15.16:0/3249555946 shutdown_connections 2024-04-25T10:39:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae97400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46424/0 (socket says 172.21.15.16:46424) 2024-04-25T10:39:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae97400640 1 -- 172.21.15.16:0/1086893233 learned_addr learned my addr 172.21.15.16:0/1086893233 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f3cd6a00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3cb006f570 0x7f3cb0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.917 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7ff5d3800640 1 -- 172.21.15.16:0/3249555946 wait complete. 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3cd008f9f0 con 0x7f3ce006c670 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cd6a00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7f3cb0078d80 0x7f3cb007b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cb007b920 con 0x7f3cb0078d80 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cd008fda0 con 0x7f3ce006c670 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f695c01a070 con 0x7f69700c7a10 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f6967e00640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f695006f5f0 0x7f6950071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f695c08ec30 con 0x7f69700c7a10 2024-04-25T10:39:28.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f6967e00640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7f6950078df0 0x7f695007b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f695c016ec0 con 0x7f6950078df0 2024-04-25T10:39:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f695c08ef30 con 0x7f69700c7a10 2024-04-25T10:39:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== osd.1 v2:172.21.15.16:6816/2432671157 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf8c009eb0 con 0x7faf74078ce0 2024-04-25T10:39:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3cb006f570 0x7f3cb0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.919 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f6975000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7f6950078df0 0x7f695007b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cdf400640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7f3cb0078d80 0x7f3cb007b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7ff5d3800640 1 Processor -- start 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.895+0000 7fae97400640 1 -- 172.21.15.16:0/1086893233 >> v2:172.21.15.16:3300/0 conn(0x7fae980cc3a0 msgr2=0x7fae980c6e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7fae97400640 1 --2- 172.21.15.16:0/1086893233 >> v2:172.21.15.16:3300/0 conn(0x7fae980cc3a0 0x7fae980c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7fae97400640 1 -- 172.21.15.16:0/1086893233 >> v1:172.21.15.186:6789/0 conn(0x7fae980c7390 legacy=0x7fae980c9d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:39:28.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7fae97400640 1 -- 172.21.15.16:0/1086893233 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9806f2b0 con 0x7fae9806d830 2024-04-25T10:39:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7ff5d3800640 1 -- start start 2024-04-25T10:39:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff34145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f60d6400640 1 --2- 172.21.15.16:0/2058889488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 0x7f60d016bf50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c401edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6b1e08d3565ae3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f60cfe00640 1 -- 172.21.15.16:0/2058889488 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c40b5070 con 0x7f60d0165890 2024-04-25T10:39:28.921 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f60cfe00640 1 -- 172.21.15.16:0/2058889488 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c40a8a90 con 0x7f60d0165890 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f60cfe00640 1 -- 172.21.15.16:0/2058889488 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c40b0440 con 0x7f60d0165890 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f6975000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7f6950078df0 0x7f695007b280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f696fe00640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f695006f5f0 0x7f6950071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff34150d30 0x7eff3414a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff341ffdd0 0x7eff342001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7eff340c7810 con 0x7eff341ffdd0 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7eff341654b0 con 0x7eff34150d30 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7eff39000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7eff340ca550 con 0x7eff14003a50 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== osd.0 v2:172.21.15.16:6800/641177332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f695c016ec0 con 0x7f6950078df0 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f696fe00640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f695006f5f0 0x7f6950071b00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f696800f370 tx=0x7f6968009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cdf400640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7f3cb0078d80 0x7f3cb007b210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.899+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== osd.2 v2:172.21.15.16:6808/659353344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3cb007b920 con 0x7f3cb0078d80 2024-04-25T10:39:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 -- 172.21.15.16:0/2058889488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 msgr2=0x7f60d016bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 --2- 172.21.15.16:0/2058889488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 0x7f60d016bf50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c401edb0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5cc0cbf50 0x7ff5cc14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f3cd7e00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3cb006f570 0x7f3cb0071a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80b2000 tx=0x7f3cc80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 -- 172.21.15.16:0/2058889488 shutdown_connections 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 --2- 172.21.15.16:0/2058889488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d0165890 0x7f60d016bf50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 --2- 172.21.15.16:0/2058889488 >> v2:172.21.15.16:3300/0 conn(0x7f60d00c9390 0x7f60d00708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 -- 172.21.15.16:0/2058889488 >> 172.21.15.16:0/2058889488 conn(0x7f60d00cdc80 msgr2=0x7f60d00c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fbc59800640 1 --2- 172.21.15.16:0/2132650145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 0x7fbc540c80b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009870 tx=0x7fbc4801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1806ab83dbb27a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fbc53e00640 1 -- 172.21.15.16:0/2132650145 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480b0070 con 0x7fbc5415a600 2024-04-25T10:39:28.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fbc53e00640 1 -- 172.21.15.16:0/2132650145 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc480ab400 con 0x7fbc5415a600 2024-04-25T10:39:28.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fbc53e00640 1 -- 172.21.15.16:0/2132650145 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc400050e0 con 0x7fbc5415a600 2024-04-25T10:39:28.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 0x7ff5cc14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae97400640 1 --2- 172.21.15.16:0/1086893233 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae840099b0 tx=0x7fae8401ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d0f8208764ce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff34145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff34145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46434/0 (socket says 172.21.15.16:46434) 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 -- 172.21.15.16:0/799426547 learned_addr learned my addr 172.21.15.16:0/799426547 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 -- 172.21.15.16:0/2058889488 shutdown_connections 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae96000640 1 -- 172.21.15.16:0/1086893233 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840b5070 con 0x7fae9806d830 2024-04-25T10:39:28.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff32a00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff34150d30 0x7eff3414a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7f60d8400640 1 -- 172.21.15.16:0/2058889488 wait complete. 2024-04-25T10:39:28.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc160e70 con 0x7ff5cc0c89d0 2024-04-25T10:39:28.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d0e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae96000640 1 -- 172.21.15.16:0/1086893233 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae840a8af0 con 0x7fae9806d830 2024-04-25T10:39:28.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae96000640 1 -- 172.21.15.16:0/1086893233 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840b0440 con 0x7fae9806d830 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff5cc160b90 con 0x7ff5cc157410 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 0x7ff5cc14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33e00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff341ffdd0 0x7eff342001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 0x7ff5cc14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33338/0 (socket says 172.21.15.16:33338) 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d3800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff5cc161150 con 0x7ff5cc0cbf50 2024-04-25T10:39:28.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 -- 172.21.15.16:0/3174906068 learned_addr learned my addr 172.21.15.16:0/3174906068 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 -- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff34150d30 msgr2=0x7eff3414a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff34150d30 0x7eff3414a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 -- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff341ffdd0 msgr2=0x7eff342001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.930 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 -- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5cc0cbf50 msgr2=0x7ff5cc14cab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5cc0cbf50 0x7ff5cc14cab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 -- 172.21.15.16:0/3174906068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc0c89d0 msgr2=0x7ff5cc153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5cc0c89d0 0x7ff5cc153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5cc153880 con 0x7ff5cc157410 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7eff341ffdd0 0x7eff342001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3414acb0 con 0x7eff14003a50 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 -- 172.21.15.16:0/1086893233 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 msgr2=0x7fae980cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 --2- 172.21.15.16:0/1086893233 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae840099b0 tx=0x7fae8401ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5d1800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 0x7ff5cc14f6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400edb0 tx=0x7ff5c400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4018020 con 0x7ff5cc157410 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 -- 172.21.15.16:0/1086893233 shutdown_connections 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 --2- 172.21.15.16:0/1086893233 >> v2:172.21.15.16:3300/0 conn(0x7fae980cc3a0 0x7fae980c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 --2- 172.21.15.16:0/1086893233 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae9806d830 0x7fae980cbe60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7fae9e800640 1 -- 172.21.15.16:0/1086893233 >> 172.21.15.16:0/1086893233 conn(0x7fae98073130 msgr2=0x7fae98073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fae9e800640 1 -- 172.21.15.16:0/1086893233 shutdown_connections 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.903+0000 7eff33400640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff34145cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff24009c30 tx=0x7eff24019930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240b2070 con 0x7eff14003a50 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff24004020 con 0x7eff14003a50 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240043f0 con 0x7eff14003a50 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 msgr2=0x7fbc540c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 --2- 172.21.15.16:0/2132650145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 0x7fbc540c80b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009870 tx=0x7fbc4801c380 comp rx=0 tx=0).stop 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 shutdown_connections 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 --2- 172.21.15.16:0/2132650145 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5415a600 0x7fbc540c80b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 >> 172.21.15.16:0/2132650145 conn(0x7fbc540c9b10 msgr2=0x7fbc540c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 shutdown_connections 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fbc5c200640 1 -- 172.21.15.16:0/2132650145 wait complete. 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c4014480 con 0x7ff5cc157410 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7eff39000640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff341502f0 con 0x7eff14003a50 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7eff39000640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff341508b0 con 0x7eff14003a50 2024-04-25T10:39:28.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff34076d30 con 0x7eff14003a50 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7f60d8400640 1 Processor -- start 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7f60d8400640 1 -- start start 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60d0070e10 0x7f60d0150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 0x7f60d0200f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60d0165890 0x7f60d015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0162500 con 0x7f60d0070e10 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f60d0162220 con 0x7f60d0165890 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f60d00c9a80 con 0x7f60d00c9390 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 0x7f60d0200f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 0x7f60d0200f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46454/0 (socket says 172.21.15.16:46454) 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 -- 172.21.15.16:0/2408054618 learned_addr learned my addr 172.21.15.16:0/2408054618 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d6400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60d0165890 0x7f60d015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 -- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60d0165890 msgr2=0x7f60d015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60d0165890 0x7f60d015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 -- 172.21.15.16:0/2408054618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60d0070e10 msgr2=0x7f60d0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60d0070e10 0x7f60d0150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d015e350 con 0x7f60d00c9390 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d5000640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 0x7f60d0200f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c4f0 tx=0x7f60c000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7fae9e800640 1 -- 172.21.15.16:0/1086893233 wait complete. 2024-04-25T10:39:28.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7fae9e800640 1 Processor -- start 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7fbc5c200640 1 Processor -- start 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7fbc5c200640 1 -- start start 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5cc153c70 con 0x7ff5cc157410 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5cc14cff0 con 0x7ff5cc157410 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4014870 con 0x7ff5cc157410 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.907+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5940010c0 con 0x7ff5cc157410 2024-04-25T10:39:28.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0017070 con 0x7f60d00c9390 2024-04-25T10:39:28.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d015c3f0 con 0x7f60d00c9390 2024-04-25T10:39:28.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c0005d30 con 0x7f60d00c9390 2024-04-25T10:39:28.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff5c401b020 con 0x7ff5cc157410 2024-04-25T10:39:28.938 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0007270 con 0x7f60d00c9390 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d015d330 con 0x7f60d00c9390 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.911+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60d0152ec0 con 0x7f60d00c9390 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f60c001a070 con 0x7f60d00c9390 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5c8c00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5a406f5a0 0x7ff5a4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff5c4090da0 con 0x7ff5cc157410 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5d0e00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5a406f5a0 0x7ff5a4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5c8c00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7ff5a4078da0 0x7ff5a407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5a407b940 con 0x7ff5a4078da0 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff5c4091190 con 0x7ff5cc157410 2024-04-25T10:39:28.939 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5cbe00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7ff5a4078da0 0x7ff5a407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7ff5d0e00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5a406f5a0 0x7ff5a4071ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0b2000 tx=0x7ff5bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7fae9e800640 1 -- start start 2024-04-25T10:39:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f60a806f550 0x7f60a8071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7eff240bf060 con 0x7eff14003a50 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f60c008f460 con 0x7f60d00c9390 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60d5a00640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f60a806f550 0x7f60a8071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f60a8078ce0 0x7f60a807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60c000ee50 con 0x7f60a8078ce0 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f60c008f850 con 0x7f60d00c9390 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.915+0000 7fbc5c200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 0x7fbc54147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.941 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5c200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc540c26c0 0x7fbc54155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5c200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc5415a600 0x7fbc540c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5c200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5415aa10 con 0x7fbc5415a600 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5c200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbc540c85f0 con 0x7fbc540c26c0 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5c200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbc541486b0 con 0x7fbc54074370 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 0x7fae980c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 0x7fbc54147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7ff5cbe00640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7ff5a4078da0 0x7ff5a407b230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 0x7fae981fc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae980cc3a0 0x7fae981fc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fae98154390 con 0x7fae980c7390 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fae980c6930 con 0x7fae9806d830 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae9e800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fae9806e990 con 0x7fae980cc3a0 2024-04-25T10:39:28.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7f60d6400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f60a8078ce0 0x7f60a807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 0x7fbc54147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46458/0 (socket says 172.21.15.16:46458) 2024-04-25T10:39:28.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 -- 172.21.15.16:0/3597450368 learned_addr learned my addr 172.21.15.16:0/3597450368 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae980cc3a0 0x7fae981fc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7f60d5a00640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f60a806f550 0x7f60a8071a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60d0071480 tx=0x7f60c80098c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae96a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 0x7fae981fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc5a200640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc5415a600 0x7fbc540c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae980cc3a0 0x7fae981fc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46472/0 (socket says 172.21.15.16:46472) 2024-04-25T10:39:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff2b400640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7eff0c06f5a0 0x7eff0c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 0x7fae980c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 0x7fae980c1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33350/0 (socket says 172.21.15.16:33350) 2024-04-25T10:39:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 -- 172.21.15.16:0/3676746318 learned_addr learned my addr 172.21.15.16:0/3676746318 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:28.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae96a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 0x7fae981fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46762/0 (socket says 172.21.15.16:46762) 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 -- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc540c26c0 msgr2=0x7fbc54155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc540c26c0 0x7fbc54155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 -- 172.21.15.16:0/3597450368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc5415a600 msgr2=0x7fbc540c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc5415a600 0x7fbc540c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7eff24129390 con 0x7eff14003a50 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff32a00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7eff0c06f5a0 0x7eff0c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc541481e0 con 0x7fbc54074370 2024-04-25T10:39:28.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 -- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae980cc3a0 msgr2=0x7fae981fc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff2b400640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7eff0c078da0 0x7eff0c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff240a5750 con 0x7eff0c078da0 2024-04-25T10:39:28.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7eff24130050 con 0x7eff14003a50 2024-04-25T10:39:28.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7f60d6400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f60a8078ce0 0x7f60a807b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc59800640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 0x7fbc54147ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc480ae040 tx=0x7fbc4801abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fae980cc3a0 0x7fae981fc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 -- 172.21.15.16:0/3676746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 msgr2=0x7fae981fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 0x7fae981fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae981fcec0 con 0x7fae9806d830 2024-04-25T10:39:28.949 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae96a00640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae980c7390 0x7fae981fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:28.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff33e00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7eff0c078da0 0x7eff0c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== osd.6 v2:172.21.15.186:6808/1602964832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5a407b940 con 0x7ff5a4078da0 2024-04-25T10:39:28.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fae97400640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 0x7fae980c1990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae8401d4e0 tx=0x7fae8401bbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480b0050 con 0x7fbc54074370 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc480bc070 con 0x7fbc54074370 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48006e60 con 0x7fbc54074370 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.919+0000 7eff32a00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7eff0c06f5a0 0x7eff0c071ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff34155cf0 tx=0x7eff20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fbc5c200640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc540c5990 con 0x7fbc54074370 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840c0070 con 0x7fae9806d830 2024-04-25T10:39:28.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae840b0e30 con 0x7fae9806d830 2024-04-25T10:39:28.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fbc5c200640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc541474a0 con 0x7fbc54074370 2024-04-25T10:39:28.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7eff33e00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7eff0c078da0 0x7eff0c07b230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840b5040 con 0x7fae9806d830 2024-04-25T10:39:28.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae98159de0 con 0x7fae9806d830 2024-04-25T10:39:28.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc10001110 con 0x7fbc54074370 2024-04-25T10:39:28.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae981fcbe0 con 0x7fae9806d830 2024-04-25T10:39:28.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== osd.3 v2:172.21.15.16:6824/2989148633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff240a5750 con 0x7eff0c078da0 2024-04-25T10:39:28.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== osd.4 v2:172.21.15.186:6800/1251728210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60c000ee50 con 0x7f60a8078ce0 2024-04-25T10:39:28.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.923+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 --> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c98002eb0 con 0x7f3cb0078d80 2024-04-25T10:39:28.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3cd6a00640 1 -- 172.21.15.16:0/2771089309 <== osd.2 v2:172.21.15.16:6808/659353344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c98002eb0 con 0x7f3cb0078d80 2024-04-25T10:39:28.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbc480a4d10 con 0x7fbc54074370 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7f3cb0078d80 msgr2=0x7f3cb007b210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7f3cb0078d80 0x7f3cb007b210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3cb006f570 msgr2=0x7f3cb0071a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3cb006f570 0x7f3cb0071a80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80b2000 tx=0x7f3cc80aa070 comp rx=0 tx=0).stop 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 msgr2=0x7f3ce015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 --2- 172.21.15.16:0/2771089309 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ce006c670 0x7f3ce015cc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000c8e0 tx=0x7f3cd000cda0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3cdf400640 1 -- 172.21.15.16:0/2771089309 reap_dead start 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 shutdown_connections 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 >> 172.21.15.16:0/2771089309 conn(0x7f3ce00c9cf0 msgr2=0x7f3ce0145d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 shutdown_connections 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7f3ccfe00640 1 -- 172.21.15.16:0/2771089309 wait complete. 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fae840c3070 con 0x7fae9806d830 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.927+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae580010c0 con 0x7fae9806d830 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc51600640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbc3006f670 0x7fbc30071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbc4812a6b0 con 0x7fbc54074370 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc51600640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7fbc30078e70 0x7fbc3007b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc48006800 con 0x7fbc30078e70 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc4812aaa0 con 0x7fbc54074370 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae8f400640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fae7006f670 0x7fae70071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fae8412ce50 con 0x7fae9806d830 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae8f400640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7fae70078e00 0x7fae7007b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae840bce80 con 0x7fae70078e00 2024-04-25T10:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fae840f59a0 con 0x7fae9806d830 2024-04-25T10:39:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc5a200640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7fbc30078e70 0x7fbc3007b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc58e00640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbc3006f670 0x7fbc30071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 --> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf98156f70 con 0x7faf74078ce0 2024-04-25T10:39:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae96a00640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fae7006f670 0x7fae70071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae97e00640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7fae70078e00 0x7fae7007b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc58e00640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbc3006f670 0x7fbc30071b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc540c7660 tx=0x7fbc40004960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fae96a00640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fae7006f670 0x7fae70071b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae98158c30 tx=0x7fae90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7faf95600640 1 -- 172.21.15.16:0/3913567969 <== osd.1 v2:172.21.15.16:6816/2432671157 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faf98156f70 con 0x7faf74078ce0 2024-04-25T10:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.931+0000 7fbc5a200640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7fbc30078e70 0x7fbc3007b300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fae97e00640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7fae70078e00 0x7fae7007b290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7faf74078ce0 msgr2=0x7faf7407b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7faf74078ce0 0x7faf7407b170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7faf7406f5d0 msgr2=0x7faf74071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7faf7406f5d0 0x7faf74071ae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faf840b9000 tx=0x7faf840b2000 comp rx=0 tx=0).stop 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 msgr2=0x7faf982093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 --2- 172.21.15.16:0/3913567969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf981530e0 0x7faf982093f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c480 tx=0x7faf8c00c940 comp rx=0 tx=0).stop 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7faf9e000640 1 -- 172.21.15.16:0/3913567969 reap_dead start 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 shutdown_connections 2024-04-25T10:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 >> 172.21.15.16:0/3913567969 conn(0x7faf980c9b10 msgr2=0x7faf9814d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 shutdown_connections 2024-04-25T10:39:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fafa0000640 1 -- 172.21.15.16:0/3913567969 wait complete. 2024-04-25T10:39:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 --> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6930002e60 con 0x7f6950078df0 2024-04-25T10:39:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== osd.5 v2:172.21.15.186:6817/1601716683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc48006800 con 0x7fbc30078e70 2024-04-25T10:39:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.935+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== osd.7 v2:172.21.15.186:6816/3819886941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae840bce80 con 0x7fae70078e00 2024-04-25T10:39:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6967e00640 1 -- 172.21.15.16:0/1097955924 <== osd.0 v2:172.21.15.16:6800/641177332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6930002e60 con 0x7f6950078df0 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7f6950078df0 msgr2=0x7f695007b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7f6950078df0 0x7f695007b280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f695006f5f0 msgr2=0x7f6950071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f695006f5f0 0x7f6950071b00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f696800f370 tx=0x7f6968009040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 msgr2=0x7f6970208fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 --2- 172.21.15.16:0/1097955924 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69700c7a10 0x7f6970208fd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69700cd040 tx=0x7f695c00ecb0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6975000640 1 -- 172.21.15.16:0/1097955924 reap_dead start 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 shutdown_connections 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 >> 172.21.15.16:0/1097955924 conn(0x7f69700c9b10 msgr2=0x7f6970158330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 shutdown_connections 2024-04-25T10:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.939+0000 7f6977000640 1 -- 172.21.15.16:0/1097955924 wait complete. 2024-04-25T10:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.947+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 --> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff594002e60 con 0x7ff5a4078da0 2024-04-25T10:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.951+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 --> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff34150af0 con 0x7eff0c078da0 2024-04-25T10:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff2b400640 1 -- 172.21.15.16:0/799426547 <== osd.3 v2:172.21.15.16:6824/2989148633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff34150af0 con 0x7eff0c078da0 2024-04-25T10:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7eff0c078da0 msgr2=0x7eff0c07b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7eff0c078da0 0x7eff0c07b230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7ff5c8c00640 1 -- 172.21.15.16:0/3174906068 <== osd.6 v2:172.21.15.186:6808/1602964832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff594002e60 con 0x7ff5a4078da0 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7eff0c06f5a0 msgr2=0x7eff0c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7eff0c06f5a0 0x7eff0c071ab0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7eff34155cf0 tx=0x7eff20009040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 msgr2=0x7eff34145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.955+0000 7eff28c00640 1 --2- 172.21.15.16:0/799426547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7eff14003a50 0x7eff34145cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7eff24009c30 tx=0x7eff24019930 comp rx=0 tx=0).stop 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7eff33e00640 1 -- 172.21.15.16:0/799426547 reap_dead start 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 shutdown_connections 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 >> 172.21.15.16:0/799426547 conn(0x7eff34071300 msgr2=0x7eff341607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 shutdown_connections 2024-04-25T10:39:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7ff5a4078da0 msgr2=0x7ff5a407b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7ff5a4078da0 0x7ff5a407b230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7eff28c00640 1 -- 172.21.15.16:0/799426547 wait complete. 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5a406f5a0 msgr2=0x7ff5a4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5a406f5a0 0x7ff5a4071ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0b2000 tx=0x7ff5bc008040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 msgr2=0x7ff5cc14f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 --2- 172.21.15.16:0/3174906068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff5cc157410 0x7ff5cc14f6e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400edb0 tx=0x7ff5c400c490 comp rx=0 tx=0).stop 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d1800640 1 -- 172.21.15.16:0/3174906068 reap_dead start 2024-04-25T10:39:28.969 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:28.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 --> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f60d015c180 con 0x7f60a8078ce0 2024-04-25T10:39:28.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:39:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 shutdown_connections 2024-04-25T10:39:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 >> 172.21.15.16:0/3174906068 conn(0x7ff5cc0d19d0 msgr2=0x7ff5cc156740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 shutdown_connections 2024-04-25T10:39:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7ff5d3800640 1 -- 172.21.15.16:0/3174906068 wait complete. 2024-04-25T10:39:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60cd600640 1 -- 172.21.15.16:0/2408054618 <== osd.4 v2:172.21.15.186:6800/1251728210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f60d015c180 con 0x7f60a8078ce0 2024-04-25T10:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f60a8078ce0 msgr2=0x7f60a807b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f60a8078ce0 0x7f60a807b170 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f60a806f550 msgr2=0x7f60a8071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f60a806f550 0x7f60a8071a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f60d0071480 tx=0x7f60c80098c0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 msgr2=0x7f60d0200f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d8400640 1 --2- 172.21.15.16:0/2408054618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60d00c9390 0x7f60d0200f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c4f0 tx=0x7f60c000c9b0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.959+0000 7f60d6400640 1 -- 172.21.15.16:0/2408054618 reap_dead start 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.963+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 shutdown_connections 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.963+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 >> 172.21.15.16:0/2408054618 conn(0x7f60d00cdc80 msgr2=0x7f60d00cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.963+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 shutdown_connections 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.963+0000 7f60d8400640 1 -- 172.21.15.16:0/2408054618 wait complete. 2024-04-25T10:39:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.967+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 --> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc10002eb0 con 0x7fbc30078e70 2024-04-25T10:39:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.967+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 --> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae58002e60 con 0x7fae70078e00 2024-04-25T10:39:28.974 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:28.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:39:28.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae8f400640 1 -- 172.21.15.16:0/3676746318 <== osd.7 v2:172.21.15.186:6816/3819886941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae58002e60 con 0x7fae70078e00 2024-04-25T10:39:28.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc51600640 1 -- 172.21.15.16:0/3597450368 <== osd.5 v2:172.21.15.186:6817/1601716683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbc10002eb0 con 0x7fbc30078e70 2024-04-25T10:39:28.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7fbc30078e70 msgr2=0x7fbc3007b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7fbc30078e70 0x7fbc3007b300 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7fae70078e00 msgr2=0x7fae7007b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7fae70078e00 0x7fae7007b290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fae7006f670 msgr2=0x7fae70071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fae7006f670 0x7fae70071b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae98158c30 tx=0x7fae90009040 comp rx=0 tx=0).stop 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 msgr2=0x7fae980c1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 --2- 172.21.15.16:0/3676746318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fae9806d830 0x7fae980c1990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae8401d4e0 tx=0x7fae8401bbd0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae97e00640 1 -- 172.21.15.16:0/3676746318 reap_dead start 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 shutdown_connections 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 >> 172.21.15.16:0/3676746318 conn(0x7fae98073130 msgr2=0x7fae9815ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 shutdown_connections 2024-04-25T10:39:28.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fae9e800640 1 -- 172.21.15.16:0/3676746318 wait complete. 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbc3006f670 msgr2=0x7fbc30071b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fbc3006f670 0x7fbc30071b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbc540c7660 tx=0x7fbc40004960 comp rx=0 tx=0).stop 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 msgr2=0x7fbc54147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 --2- 172.21.15.16:0/3597450368 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc54074370 0x7fbc54147ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc480ae040 tx=0x7fbc4801abc0 comp rx=0 tx=0).stop 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc5a200640 1 -- 172.21.15.16:0/3597450368 reap_dead start 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 shutdown_connections 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 >> 172.21.15.16:0/3597450368 conn(0x7fbc540c9b10 msgr2=0x7fbc5415af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 shutdown_connections 2024-04-25T10:39:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:28.971+0000 7fbc46a00640 1 -- 172.21.15.16:0/3597450368 wait complete. 2024-04-25T10:39:28.986 INFO:teuthology.orchestra.run.smithi016.stdout:55834574860 2024-04-25T10:39:28.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:39:29.002 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.002 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:39:29.004 INFO:teuthology.orchestra.run.smithi016.stdout:55834574860 2024-04-25T10:39:29.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:39:29.008 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.009 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:39:29.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:39:29.018 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.018 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:39:29.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.231+0000 7f5271200640 1 Processor -- start 2024-04-25T10:39:29.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.235+0000 7f5271200640 1 -- start start 2024-04-25T10:39:29.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.235+0000 7f9157400640 1 Processor -- start 2024-04-25T10:39:29.243 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5271200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5271200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5269e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9157400640 1 -- start start 2024-04-25T10:39:29.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5269400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5269400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46488/0 (socket says 172.21.15.16:46488) 2024-04-25T10:39:29.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5269e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46780/0 (socket says 172.21.15.16:46780) 2024-04-25T10:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9157400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9148007f80 0x7f9148008390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5269400640 1 -- 172.21.15.16:0/179621466 learned_addr learned my addr 172.21.15.16:0/179621466 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52640471b0 con 0x7f52640077b0 2024-04-25T10:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5264046370 con 0x7f52640da920 2024-04-25T10:39:29.246 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5264033c20 con 0x7f52640340b0 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9157400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480e4870 con 0x7f914804dc40 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9157400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480e4b30 con 0x7f91480e8010 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9157400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f91480e4e10 con 0x7f9148007f80 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9154a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f914804dc40 0x7f91480de940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38460/0 (socket says 172.21.15.16:38460) 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f5269400640 1 -- 172.21.15.16:0/179621466 >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 msgr2=0x7f52640e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f5269400640 1 --2- 172.21.15.16:0/179621466 >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f5269400640 1 -- 172.21.15.16:0/179621466 >> v1:172.21.15.16:6789/0 conn(0x7f52640077b0 legacy=0x7f526404afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.239+0000 7f9154a00640 1 -- 172.21.15.16:0/840433124 learned_addr learned my addr 172.21.15.16:0/840433124 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673833932 0 0) 0x7f91480e4870 con 0x7f914804dc40 2024-04-25T10:39:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91380035c0 con 0x7f914804dc40 2024-04-25T10:39:29.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914fe00640 1 --2- 172.21.15.16:0/840433124 >> v2:172.21.15.186:3300/0 conn(0x7f9148007f80 0x7f9148008390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f5269400640 1 -- 172.21.15.16:0/179621466 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5264047490 con 0x7f52640340b0 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f5269e00640 1 --2- 172.21.15.16:0/179621466 >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575140821 0 0) 0x7f91480e4b30 con 0x7f91480e8010 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9138003920 con 0x7f91480e8010 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1520332985 0 0) 0x7f91380035c0 con 0x7f914804dc40 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 >> v2:172.21.15.186:3300/0 conn(0x7f9148007f80 msgr2=0x7f9148008390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 --2- 172.21.15.16:0/840433124 >> v2:172.21.15.186:3300/0 conn(0x7f9148007f80 0x7f9148008390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 >> v1:172.21.15.186:6789/0 conn(0x7f91480e8010 legacy=0x7f91480e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.243+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480e50f0 con 0x7f914804dc40 2024-04-25T10:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f9144001630 con 0x7f914804dc40 2024-04-25T10:39:29.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 >> v1:172.21.15.16:6789/0 conn(0x7f914804dc40 legacy=0x7f91480de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138003dd0 0x7f9138004220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91380048a0 0x7f9138004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 0x7f913800be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f91480e4e10 con 0x7f9138009a50 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f913800c4c0 con 0x7f91380048a0 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f913800c6c0 con 0x7f9138003dd0 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9154a00640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138003dd0 0x7f9138004220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 0x7f913800be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f914fe00640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91380048a0 0x7f9138004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 -- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138003dd0 msgr2=0x7f9138004220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138003dd0 0x7f9138004220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 -- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91380048a0 msgr2=0x7f9138004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91380048a0 0x7f9138004d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f9155400640 1 -- 172.21.15.16:0/840433124 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91380035c0 con 0x7f9138009a50 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f5269400640 1 --2- 172.21.15.16:0/179621466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52580099d0 tx=0x7f525801c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfcb5f49028ef9ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f5268a00640 1 -- 172.21.15.16:0/179621466 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580b0070 con 0x7f52640340b0 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f5268a00640 1 -- 172.21.15.16:0/179621466 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52580ab600 con 0x7f52640340b0 2024-04-25T10:39:29.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.247+0000 7f5268a00640 1 -- 172.21.15.16:0/179621466 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580aba10 con 0x7f52640340b0 2024-04-25T10:39:29.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 msgr2=0x7f5264007270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 --2- 172.21.15.16:0/179621466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52580099d0 tx=0x7f525801c590 comp rx=0 tx=0).stop 2024-04-25T10:39:29.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 shutdown_connections 2024-04-25T10:39:29.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 --2- 172.21.15.16:0/179621466 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640340b0 0x7f5264007270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 --2- 172.21.15.16:0/179621466 >> v2:172.21.15.16:3300/0 conn(0x7f52640da920 0x7f52640e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 >> 172.21.15.16:0/179621466 conn(0x7f5264051080 msgr2=0x7f526404d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 shutdown_connections 2024-04-25T10:39:29.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f9155400640 1 -- 172.21.15.16:0/840433124 reap_dead start 2024-04-25T10:39:29.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f9155400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 0x7f913800be70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915006afe0 tx=0x7f9150099630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae43051baaff4c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 -- 172.21.15.16:0/179621466 wait complete. 2024-04-25T10:39:29.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.251+0000 7f5271200640 1 Processor -- start 2024-04-25T10:39:29.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 -- start start 2024-04-25T10:39:29.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91500640a0 con 0x7f9138009a50 2024-04-25T10:39:29.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9150127610 con 0x7f9138009a50 2024-04-25T10:39:29.259 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f914f400640 1 -- 172.21.15.16:0/840433124 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91501279e0 con 0x7f9138009a50 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 0x7f52640d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 0x7f52640cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640da920 0x7f52640d0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f52640365e0 con 0x7f52640340b0 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5264046050 con 0x7f52640077b0 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5271200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f52640344c0 con 0x7f52640da920 2024-04-25T10:39:29.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 0x7f52640cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 0x7f52640cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46794/0 (socket says 172.21.15.16:46794) 2024-04-25T10:39:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269400640 1 -- 172.21.15.16:0/2199324899 learned_addr learned my addr 172.21.15.16:0/2199324899 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 0x7f52640d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 -- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 msgr2=0x7f913800be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 0x7f913800be70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f915006afe0 tx=0x7f9150099630 comp rx=0 tx=0).stop 2024-04-25T10:39:29.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f526a800640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640da920 0x7f52640d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 -- 172.21.15.16:0/840433124 shutdown_connections 2024-04-25T10:39:29.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 --2- 172.21.15.16:0/840433124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9138009a50 0x7f913800be70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 -- 172.21.15.16:0/840433124 >> 172.21.15.16:0/840433124 conn(0x7f914800a190 msgr2=0x7f914800a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 -- 172.21.15.16:0/840433124 shutdown_connections 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 -- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640da920 msgr2=0x7f52640d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640da920 0x7f52640d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 -- 172.21.15.16:0/2199324899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 msgr2=0x7f52640cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 0x7f52640cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f5269e00640 1 -- 172.21.15.16:0/2199324899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52640d41c0 con 0x7f52640077b0 2024-04-25T10:39:29.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5269e00640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 0x7f52640d3c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f525c00e820 tx=0x7f525c00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.255+0000 7f9157400640 1 -- 172.21.15.16:0/840433124 wait complete. 2024-04-25T10:39:29.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c017070 con 0x7f52640077b0 2024-04-25T10:39:29.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c009890 con 0x7f52640077b0 2024-04-25T10:39:29.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c00f040 con 0x7f52640077b0 2024-04-25T10:39:29.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52640d4cf0 con 0x7f52640077b0 2024-04-25T10:39:29.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52640d43d0 con 0x7f52640077b0 2024-04-25T10:39:29.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f9157400640 1 Processor -- start 2024-04-25T10:39:29.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.259+0000 7f9157400640 1 -- start start 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f6875400640 1 Processor -- start 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138009a50 0x7f91480e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9148173810 0x7f9148182ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9148047bb0 con 0x7f9148035210 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f914804e050 con 0x7f9148173810 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f9157400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9148047d30 con 0x7f9138009a50 2024-04-25T10:39:29.271 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f914fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f914fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46802/0 (socket says 172.21.15.16:46802) 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f914fe00640 1 -- 172.21.15.16:0/1905559085 learned_addr learned my addr 172.21.15.16:0/1905559085 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f9154a00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138009a50 0x7f91480e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f9155400640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9148173810 0x7f9148182ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 -- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138009a50 msgr2=0x7f91480e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138009a50 0x7f91480e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 -- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9148173810 msgr2=0x7f9148182ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9148173810 0x7f9148182ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f522c005420 con 0x7f52640077b0 2024-04-25T10:39:29.272 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f525c01a070 con 0x7f52640077b0 2024-04-25T10:39:29.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 -- 172.21.15.16:0/1905559085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480da920 con 0x7f9148035210 2024-04-25T10:39:29.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f5262000640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 0x7f5244071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.273 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.263+0000 7f6875400640 1 -- start start 2024-04-25T10:39:29.274 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f525c08f1b0 con 0x7f52640077b0 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f6875400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f6875400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6870071bd0 0x7f68700708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f6875400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f687015a060 con 0x7f68700c7c40 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f6875400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f68701539b0 con 0x7f6870071bd0 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f6875400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f68700c6a20 con 0x7f68700c9450 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46530/0 (socket says 172.21.15.16:46530) 2024-04-25T10:39:29.275 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f5269400640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 0x7f5244071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 -- 172.21.15.16:0/938954434 learned_addr learned my addr 172.21.15.16:0/938954434 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686f200640 1 --2- 172.21.15.16:0/938954434 >> v2:172.21.15.186:3300/0 conn(0x7f6870071bd0 0x7f68700708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 -- 172.21.15.16:0/938954434 >> v2:172.21.15.186:3300/0 conn(0x7f6870071bd0 msgr2=0x7f68700708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 --2- 172.21.15.16:0/938954434 >> v2:172.21.15.186:3300/0 conn(0x7f6870071bd0 0x7f68700708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.276 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 -- 172.21.15.16:0/938954434 >> v1:172.21.15.186:6789/0 conn(0x7f68700c7c40 legacy=0x7f68700c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f2293800640 1 Processor -- start 2024-04-25T10:39:29.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f686e800640 1 -- 172.21.15.16:0/938954434 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700c50a0 con 0x7f68700c9450 2024-04-25T10:39:29.277 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f5269400640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 0x7f5244071ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f525801c5d0 tx=0x7f5258008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.271+0000 7f2293800640 1 -- start start 2024-04-25T10:39:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914fe00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f913c006fd0 tx=0x7f913c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.271+0000 7f2293800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f228c0c80b0 0x7f228c155180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c019020 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f9157400640 1 -- 172.21.15.16:0/1905559085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91480378f0 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f9157400640 1 -- 172.21.15.16:0/1905559085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9148037610 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.267+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c015690 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.271+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c019020 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.271+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114005470 con 0x7f9148035210 2024-04-25T10:39:29.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f913c01c020 con 0x7f9148035210 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2293800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0c78d0 con 0x7f228c15ee70 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2293800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0c6b80 con 0x7f228c0cbe60 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2293800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0c6e40 con 0x7f228c0c80b0 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2291800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f228c15ee70 0x7f228c1658b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38468/0 (socket says 172.21.15.16:38468) 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2291800640 1 -- 172.21.15.16:0/2772694713 learned_addr learned my addr 172.21.15.16:0/2772694713 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:29.280 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2290e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f228c0c80b0 0x7f228c155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f9f05200640 1 Processor -- start 2024-04-25T10:39:29.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f686e800640 1 --2- 172.21.15.16:0/938954434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6868009fa0 tx=0x7f686801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d764969ebc5d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f9f05200640 1 -- start start 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2290e00640 1 -- 172.21.15.16:0/2772694713 >> v1:172.21.15.186:6789/0 conn(0x7f228c0cbe60 legacy=0x7f228c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2290e00640 1 -- 172.21.15.16:0/2772694713 >> v1:172.21.15.16:6789/0 conn(0x7f228c15ee70 legacy=0x7f228c1658b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f2290e00640 1 -- 172.21.15.16:0/2772694713 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0c75f0 con 0x7f228c0c80b0 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f686d400640 1 -- 172.21.15.16:0/938954434 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680a55e0 con 0x7f68700c9450 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f686d400640 1 -- 172.21.15.16:0/938954434 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68680a5780 con 0x7f68700c9450 2024-04-25T10:39:29.282 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f686d400640 1 -- 172.21.15.16:0/938954434 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680a5b90 con 0x7f68700c9450 2024-04-25T10:39:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f914cc00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 0x7f9124071c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f913c08ffa0 con 0x7f9148035210 2024-04-25T10:39:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 -- 172.21.15.16:0/938954434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 msgr2=0x7f6870153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.283 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 --2- 172.21.15.16:0/938954434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6868009fa0 tx=0x7f686801ca30 comp rx=0 tx=0).stop 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f9154a00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 0x7f9124071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 -- 172.21.15.16:0/938954434 shutdown_connections 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 --2- 172.21.15.16:0/938954434 >> v2:172.21.15.186:3300/0 conn(0x7f6870071bd0 0x7f68700708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 --2- 172.21.15.16:0/938954434 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f68700c9450 0x7f6870153470 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.275+0000 7f6875400640 1 -- 172.21.15.16:0/938954434 >> 172.21.15.16:0/938954434 conn(0x7f68700ca620 msgr2=0x7f687006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f6875400640 1 -- 172.21.15.16:0/938954434 shutdown_connections 2024-04-25T10:39:29.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 Processor -- start 2024-04-25T10:39:29.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9f05200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9f00153fc0 0x7f9f000c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.285 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 -- start start 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9f05200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9f05200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f000ca9e0 con 0x7f9f000c9190 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9f05200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f9f000c7c40 con 0x7f9f000c4df0 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9f05200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f9f000c7e90 con 0x7f9f00153fc0 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f6875400640 1 -- 172.21.15.16:0/938954434 wait complete. 2024-04-25T10:39:29.286 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f2290e00640 1 --2- 172.21.15.16:0/2772694713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c155180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ed0 tx=0x7f228401f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e86b9af23f89753 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f0412800640 1 Processor -- start 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 0x7f7d6c0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 0x7f7d6c1658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6c0b8f60 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6c0c9bb0 con 0x7f7d6c0c97a0 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d70a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6c0b9ac0 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f0412800640 1 -- start start 2024-04-25T10:39:29.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9154a00640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 0x7f9124071c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9144000fc0 tx=0x7f9144009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d6a800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 0x7f7d6c1658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d69400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 0x7f7d6c0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d6a800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 0x7f7d6c1658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33414/0 (socket says 172.21.15.16:33414) 2024-04-25T10:39:29.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f7d6a800640 1 -- 172.21.15.16:0/3374587977 learned_addr learned my addr 172.21.15.16:0/3374587977 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f6875400640 1 Processor -- start 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9efde00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9f00153fc0 0x7f9f000c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9efe800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9efde00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9f00153fc0 0x7f9f000c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33406/0 (socket says 172.21.15.16:33406) 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9efe800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46826/0 (socket says 172.21.15.16:46826) 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.279+0000 7f9efde00640 1 -- 172.21.15.16:0/1818860490 learned_addr learned my addr 172.21.15.16:0/1818860490 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.289 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f6875400640 1 -- start start 2024-04-25T10:39:29.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f9efde00640 1 -- 172.21.15.16:0/1818860490 >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 msgr2=0x7f9f001647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f7d69400640 1 -- 172.21.15.16:0/3374587977 >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 msgr2=0x7f7d6c1658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f7d69400640 1 --2- 172.21.15.16:0/3374587977 >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 0x7f7d6c1658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f7d69400640 1 -- 172.21.15.16:0/3374587977 >> v1:172.21.15.186:6789/0 conn(0x7f7d6c0c7c40 legacy=0x7f7d6c0c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f7d69400640 1 -- 172.21.15.16:0/3374587977 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c0b9220 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f9efde00640 1 --2- 172.21.15.16:0/1818860490 >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f9efde00640 1 -- 172.21.15.16:0/1818860490 >> v1:172.21.15.16:6789/0 conn(0x7f9f000c9190 legacy=0x7f9f000c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f9efde00640 1 -- 172.21.15.16:0/1818860490 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f000c8170 con 0x7f9f00153fc0 2024-04-25T10:39:29.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f9efe800640 1 --2- 172.21.15.16:0/1818860490 >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:29.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f525c05b630 con 0x7f52640077b0 2024-04-25T10:39:29.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f0412800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 0x7f040c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f913c023020 con 0x7f9148035210 2024-04-25T10:39:29.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f228b400640 1 -- 172.21.15.16:0/2772694713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840b4070 con 0x7f228c0c80b0 2024-04-25T10:39:29.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f228b400640 1 -- 172.21.15.16:0/2772694713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22840af600 con 0x7f228c0c80b0 2024-04-25T10:39:29.292 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f228b400640 1 -- 172.21.15.16:0/2772694713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840afa10 con 0x7f228c0c80b0 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f0412800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 0x7f040c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f0412800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040c15e750 con 0x7f040c15b1f0 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f0412800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f040c0c3dd0 con 0x7f040c0c8080 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f0412800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f040c15e4f0 con 0x7f040c0c7c70 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f040aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 0x7f040c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f040aa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 0x7f040c0cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46838/0 (socket says 172.21.15.16:46838) 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f040aa00640 1 -- 172.21.15.16:0/1379812073 learned_addr learned my addr 172.21.15.16:0/1379812073 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f040b400640 1 --2- 172.21.15.16:0/1379812073 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 0x7f040c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f6875400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.283+0000 7f6875400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 0x7f6870153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 -- 172.21.15.16:0/2772694713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 msgr2=0x7f228c155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 --2- 172.21.15.16:0/2772694713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c155180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ed0 tx=0x7f228401f260 comp rx=0 tx=0).stop 2024-04-25T10:39:29.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46552/0 (socket says 172.21.15.16:46552) 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 -- 172.21.15.16:0/2304189481 learned_addr learned my addr 172.21.15.16:0/2304189481 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68700c9450 0x7f6870145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6870159c80 con 0x7f68700c7c40 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f68700c5c20 con 0x7f68700c9450 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6870159e00 con 0x7f6870071bd0 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f040b400640 1 -- 172.21.15.16:0/1379812073 >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 msgr2=0x7f040c0cc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f040b400640 1 --2- 172.21.15.16:0/1379812073 >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 0x7f040c0cc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f040b400640 1 -- 172.21.15.16:0/1379812073 >> v1:172.21.15.16:6789/0 conn(0x7f040c15b1f0 legacy=0x7f040c15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f040b400640 1 -- 172.21.15.16:0/1379812073 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c15ea30 con 0x7f040c0c7c70 2024-04-25T10:39:29.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686f200640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68700c9450 0x7f6870145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 -- 172.21.15.16:0/2772694713 shutdown_connections 2024-04-25T10:39:29.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 --2- 172.21.15.16:0/2772694713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c155180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 -- 172.21.15.16:0/2772694713 >> 172.21.15.16:0/2772694713 conn(0x7f228c073130 msgr2=0x7f228c073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686de00640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 0x7f6870153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 -- 172.21.15.16:0/2772694713 shutdown_connections 2024-04-25T10:39:29.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 -- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68700c9450 msgr2=0x7f6870145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68700c9450 0x7f6870145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.297 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 -- 172.21.15.16:0/2304189481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 msgr2=0x7f6870153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f2293800640 1 -- 172.21.15.16:0/2772694713 wait complete. 2024-04-25T10:39:29.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 0x7f6870153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6870154160 con 0x7f6870071bd0 2024-04-25T10:39:29.298 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686de00640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 0x7f6870153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:29.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f9efde00640 1 --2- 172.21.15.16:0/1818860490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f000c8c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c7dc0 tx=0x7f9eec01c640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70c5a509bc974d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f7d69400640 1 --2- 172.21.15.16:0/3374587977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 0x7f7d6c0c9260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800dd20 tx=0x7f7d58020820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd157b672677932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f686e800640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68680af040 tx=0x7f68680197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f9efca00640 1 -- 172.21.15.16:0/1818860490 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0b0070 con 0x7f9f00153fc0 2024-04-25T10:39:29.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f7d68a00640 1 -- 172.21.15.16:0/3374587977 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800d0d0 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f7d68a00640 1 -- 172.21.15.16:0/3374587977 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5800d270 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f7d68a00640 1 -- 172.21.15.16:0/3374587977 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580a9800 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f9efca00640 1 -- 172.21.15.16:0/1818860490 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec0ab600 con 0x7f9f00153fc0 2024-04-25T10:39:29.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f9efca00640 1 -- 172.21.15.16:0/1818860490 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0b0070 con 0x7f9f00153fc0 2024-04-25T10:39:29.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680bc020 con 0x7f6870071bd0 2024-04-25T10:39:29.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68680b8880 con 0x7f6870071bd0 2024-04-25T10:39:29.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.287+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680a55e0 con 0x7f6870071bd0 2024-04-25T10:39:29.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68701faba0 con 0x7f6870071bd0 2024-04-25T10:39:29.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f040b400640 1 --2- 172.21.15.16:0/1379812073 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 0x7f040c0cbec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009900 tx=0x7f03fc01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4366aa3d84cbfa03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68701fb160 con 0x7f6870071bd0 2024-04-25T10:39:29.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f9f05200640 1 -- 172.21.15.16:0/1818860490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 msgr2=0x7f9f000c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f9f05200640 1 --2- 172.21.15.16:0/1818860490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f000c8c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c7dc0 tx=0x7f9eec01c640 comp rx=0 tx=0).stop 2024-04-25T10:39:29.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6830005420 con 0x7f6870071bd0 2024-04-25T10:39:29.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f040a000640 1 -- 172.21.15.16:0/1379812073 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0b0070 con 0x7f040c0c7c70 2024-04-25T10:39:29.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f040a000640 1 -- 172.21.15.16:0/1379812073 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc0ab600 con 0x7f040c0c7c70 2024-04-25T10:39:29.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f040a000640 1 -- 172.21.15.16:0/1379812073 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0ab9d0 con 0x7f040c0c7c70 2024-04-25T10:39:29.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f2293800640 1 Processor -- start 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 -- 172.21.15.16:0/3374587977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 msgr2=0x7f7d6c0c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 --2- 172.21.15.16:0/3374587977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 0x7f7d6c0c9260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800dd20 tx=0x7f7d58020820 comp rx=0 tx=0).stop 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f2293800640 1 -- start start 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 -- 172.21.15.16:0/3374587977 shutdown_connections 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 --2- 172.21.15.16:0/3374587977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c15b9d0 0x7f7d6c0c9260 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 --2- 172.21.15.16:0/3374587977 >> v2:172.21.15.186:3300/0 conn(0x7f7d6c0c97a0 0x7f7d6c1658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 -- 172.21.15.16:0/3374587977 >> 172.21.15.16:0/3374587977 conn(0x7f7d6c0cdc80 msgr2=0x7f7d6c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 -- 172.21.15.16:0/1379812073 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 msgr2=0x7f040c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 --2- 172.21.15.16:0/1379812073 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 0x7f040c0cbec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009900 tx=0x7f03fc01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 -- 172.21.15.16:0/3374587977 shutdown_connections 2024-04-25T10:39:29.305 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f7d70a00640 1 -- 172.21.15.16:0/3374587977 wait complete. 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 -- 172.21.15.16:0/1379812073 shutdown_connections 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 --2- 172.21.15.16:0/1379812073 >> v2:172.21.15.16:3300/0 conn(0x7f040c0c8080 0x7f040c0cc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 --2- 172.21.15.16:0/1379812073 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c0c7c70 0x7f040c0cbec0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 -- 172.21.15.16:0/1379812073 >> 172.21.15.16:0/1379812073 conn(0x7f040c073150 msgr2=0x7f040c073640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.291+0000 7f0412800640 1 -- 172.21.15.16:0/1379812073 shutdown_connections 2024-04-25T10:39:29.306 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f0412800640 1 -- 172.21.15.16:0/1379812073 wait complete. 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 -- 172.21.15.16:0/1818860490 shutdown_connections 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 --2- 172.21.15.16:0/1818860490 >> v2:172.21.15.16:3300/0 conn(0x7f9f000c4df0 0x7f9f001647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 --2- 172.21.15.16:0/1818860490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f000c8c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 -- 172.21.15.16:0/1818860490 >> 172.21.15.16:0/1818860490 conn(0x7f9f000cdc80 msgr2=0x7f9f000c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 -- 172.21.15.16:0/1818860490 shutdown_connections 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f9f05200640 1 -- 172.21.15.16:0/1818860490 wait complete. 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f68680bf020 con 0x7f6870071bd0 2024-04-25T10:39:29.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f7d70a00640 1 Processor -- start 2024-04-25T10:39:29.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f6866a00640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 0x7f6848071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f228c0cbe60 0x7f228c14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.308 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f686812a770 con 0x7f6870071bd0 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0cb990 con 0x7f228c0c80b0 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f228c1556c0 con 0x7f228c15ee70 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2293800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0cbb10 con 0x7f228c0cbe60 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2290e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2291800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2291800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33436/0 (socket says 172.21.15.16:33436) 2024-04-25T10:39:29.309 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f2291800640 1 -- 172.21.15.16:0/1402675430 learned_addr learned my addr 172.21.15.16:0/1402675430 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f0412800640 1 Processor -- start 2024-04-25T10:39:29.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f0412800640 1 -- start start 2024-04-25T10:39:29.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f228be00640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f228c0cbe60 0x7f228c14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 -- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f228c0cbe60 msgr2=0x7f228c14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f228c0cbe60 0x7f228c14b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 -- 172.21.15.16:0/1402675430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 msgr2=0x7f228c149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 -- 172.21.15.16:0/1402675430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c14b8f0 con 0x7f228c15ee70 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2290e00640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.295+0000 7f7d70a00640 1 -- start start 2024-04-25T10:39:29.311 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2291800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c480 tx=0x7f227c001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f9f05200640 1 Processor -- start 2024-04-25T10:39:29.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 0x7f7d6c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f686de00640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 0x7f6848071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.312 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f686de00640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 0x7f6848071ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68701646d0 tx=0x7f685c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c017070 con 0x7f228c15ee70 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c005d30 con 0x7f228c15ee70 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c14d1c0 con 0x7f228c15ee70 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0072d0 con 0x7f228c15ee70 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c14ae90 con 0x7f228c15ee70 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 0x7f7d6c135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d6c15b9d0 0x7f7d6c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c0c8150 con 0x7f7d6c15b9d0 2024-04-25T10:39:29.313 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c15bde0 con 0x7f7d6c0c97a0 2024-04-25T10:39:29.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d70a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6c0c82d0 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f9f05200640 1 -- start start 2024-04-25T10:39:29.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d69400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 0x7f7d6c135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d69400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 0x7f7d6c135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33446/0 (socket says 172.21.15.16:33446) 2024-04-25T10:39:29.314 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d69400640 1 -- 172.21.15.16:0/4121240787 learned_addr learned my addr 172.21.15.16:0/4121240787 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.299+0000 7f7d6a800640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d6c15b9d0 0x7f7d6c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 0x7f7d6c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 0x7f9f0016b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 0x7f9f00204030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f001565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9f00154550 con 0x7f9f000c9190 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9f001543d0 con 0x7f9f00153fc0 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9f05200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9f000ca5a0 con 0x7f9f000c4df0 2024-04-25T10:39:29.315 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 0x7f9f00204030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efd400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 0x7f9f00204030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46874/0 (socket says 172.21.15.16:46874) 2024-04-25T10:39:29.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efd400640 1 -- 172.21.15.16:0/612094595 learned_addr learned my addr 172.21.15.16:0/612094595 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.316 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efe800640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f001565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f040c0c8080 0x7f040c14ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c14cf50 con 0x7f228c15ee70 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33476/0 (socket says 172.21.15.16:33476) 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 -- 172.21.15.16:0/3026421212 learned_addr learned my addr 172.21.15.16:0/3026421212 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.317 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 0x7f9f0016b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c15b1f0 0x7f040c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f040c155770 con 0x7f040c0c8080 2024-04-25T10:39:29.318 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 -- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 msgr2=0x7f9f001565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040be00640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c15b1f0 0x7f040c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1555f0 con 0x7f040c0c7c70 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f040c168090 con 0x7f040c15b1f0 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f001565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 -- 172.21.15.16:0/612094595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 msgr2=0x7f9f00204030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 0x7f9f00204030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 -- 172.21.15.16:0/612094595 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f00204570 con 0x7f9f000c4df0 2024-04-25T10:39:29.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f9efde00640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 0x7f9f0016b550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b9230 tx=0x7f9eec0193e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 -- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 msgr2=0x7f7d6c135ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 0x7f7d6c135ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 -- 172.21.15.16:0/4121240787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d6c15b9d0 msgr2=0x7f7d6c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d6c15b9d0 0x7f7d6c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040aa00640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f040c0c8080 0x7f040c14ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 -- 172.21.15.16:0/4121240787 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c165b90 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f7d69e00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 0x7f7d6c155b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c770 tx=0x7f7d6400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f227c01a070 con 0x7f228c15ee70 2024-04-25T10:39:29.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 -- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c15b1f0 msgr2=0x7f040c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c15b1f0 0x7f040c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 -- 172.21.15.16:0/3026421212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f040c0c8080 msgr2=0x7f040c14ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f040c0c8080 0x7f040c14ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.303+0000 7f040b400640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c15ce70 con 0x7f040c0c7c70 2024-04-25T10:39:29.322 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.307+0000 7f040b400640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03fc01ab80 tx=0x7f03fc019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.307+0000 7f2288c00640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 0x7f2264071b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.307+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f227c08e7f0 con 0x7f228c15ee70 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.307+0000 7f2290e00640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 0x7f2264071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.307+0000 7f2290e00640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 0x7f2264071b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f22840b1000 tx=0x7f22840aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64016020 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d64006d60 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0b0040 con 0x7f9f000c4df0 2024-04-25T10:39:29.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f00156b20 con 0x7f9f000c4df0 2024-04-25T10:39:29.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec0b9070 con 0x7f9f000c4df0 2024-04-25T10:39:29.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0abbb0 con 0x7f9f000c4df0 2024-04-25T10:39:29.324 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64003bc0 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0014cd50 con 0x7f9f000c4df0 2024-04-25T10:39:29.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c200090 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.311+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c137d60 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68680c6030 con 0x7f6870071bd0 2024-04-25T10:39:29.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f00050750 con 0x7f9f000c4df0 2024-04-25T10:39:29.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d2c005420 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7d6400a850 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9eec0ab480 con 0x7f9f000c4df0 2024-04-25T10:39:29.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.315+0000 7f7d62000640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 0x7f7d40071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7d6408f130 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f7d69400640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 0x7f7d40071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f9ef6000640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 0x7f9ed8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9eec1294b0 con 0x7f9f000c4df0 2024-04-25T10:39:29.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f9efd400640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 0x7f9ed8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f7d69400640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 0x7f7d40071a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800d040 tx=0x7f7d580ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.328 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f9efd400640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 0x7f9ed8071ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f00164cd0 tx=0x7f9ef0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0b9020 con 0x7f040c0c7c70 2024-04-25T10:39:29.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f227c05ae10 con 0x7f228c15ee70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c1fb9f0 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1fc270 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc0b5480 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.319+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0b9020 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.323+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03cc005420 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.323+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f03fc0bc020 con 0x7f040c0c7c70 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.323+0000 7f0403400640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 0x7f03e4071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.330 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.323+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f03fc129680 con 0x7f040c0c7c70 2024-04-25T10:39:29.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.327+0000 7f040aa00640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 0x7f03e4071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.327+0000 7f040aa00640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 0x7f03e4071cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f040c1518b0 tx=0x7f03f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.331+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f00204570 con 0x7f9f000c4df0 2024-04-25T10:39:29.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.339+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f03fc016150 con 0x7f040c0c7c70 2024-04-25T10:39:29.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.343+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d64020020 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.351+0000 7f7f32c00640 1 Processor -- start 2024-04-25T10:39:29.357 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.351+0000 7f7f32c00640 1 -- start start 2024-04-25T10:39:29.358 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32c00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f2c0ca790 0x7f7f2c163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f2c159e40 con 0x7f7f2c0c97e0 2024-04-25T10:39:29.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32c00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7f2c0c4b10 con 0x7f7f2c0ca790 2024-04-25T10:39:29.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0c4580 con 0x7f7f2c153180 2024-04-25T10:39:29.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46606/0 (socket says 172.21.15.16:46606) 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 -- 172.21.15.16:0/3577238050 learned_addr learned my addr 172.21.15.16:0/3577238050 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f32200640 1 --2- 172.21.15.16:0/3577238050 >> v2:172.21.15.186:3300/0 conn(0x7f7f2c0ca790 0x7f7f2c163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 -- 172.21.15.16:0/3577238050 >> v2:172.21.15.186:3300/0 conn(0x7f7f2c0ca790 msgr2=0x7f7f2c163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 --2- 172.21.15.16:0/3577238050 >> v2:172.21.15.186:3300/0 conn(0x7f7f2c0ca790 0x7f7f2c163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 -- 172.21.15.16:0/3577238050 >> v1:172.21.15.16:6789/0 conn(0x7f7f2c0c97e0 legacy=0x7f7f2c15cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:29.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.355+0000 7f7f30e00640 1 -- 172.21.15.16:0/3577238050 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c1592c0 con 0x7f7f2c153180 2024-04-25T10:39:29.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.359+0000 7f7f30e00640 1 --2- 172.21.15.16:0/3577238050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f180073c0 tx=0x7f7f1801d3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45692a68e11b0980 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.359+0000 7f7f2be00640 1 -- 172.21.15.16:0/3577238050 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180b1070 con 0x7f7f2c153180 2024-04-25T10:39:29.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.359+0000 7f7f2be00640 1 -- 172.21.15.16:0/3577238050 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f18008be0 con 0x7f7f2c153180 2024-04-25T10:39:29.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.359+0000 7f7f2be00640 1 -- 172.21.15.16:0/3577238050 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800a2f0 con 0x7f7f2c153180 2024-04-25T10:39:29.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 -- 172.21.15.16:0/3577238050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 msgr2=0x7f7f2c0ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 --2- 172.21.15.16:0/3577238050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f180073c0 tx=0x7f7f1801d3e0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 -- 172.21.15.16:0/3577238050 shutdown_connections 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 --2- 172.21.15.16:0/3577238050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c153180 0x7f7f2c0ca250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 --2- 172.21.15.16:0/3577238050 >> v2:172.21.15.186:3300/0 conn(0x7f7f2c0ca790 0x7f7f2c163870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 -- 172.21.15.16:0/3577238050 >> 172.21.15.16:0/3577238050 conn(0x7f7f2c071300 msgr2=0x7f7f2c0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 -- 172.21.15.16:0/3577238050 shutdown_connections 2024-04-25T10:39:29.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.363+0000 7f7f32c00640 1 -- 172.21.15.16:0/3577238050 wait complete. 2024-04-25T10:39:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.367+0000 7f7f32c00640 1 Processor -- start 2024-04-25T10:39:29.372 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.367+0000 7f7f32c00640 1 -- start start 2024-04-25T10:39:29.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0c97e0 0x7f7f2c14da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f2c153180 0x7f7f2c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0c9bf0 con 0x7f7f2c0c97e0 2024-04-25T10:39:29.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c15c690 con 0x7f7f2c153180 2024-04-25T10:39:29.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c153590 con 0x7f7f2c0ca790 2024-04-25T10:39:29.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46618/0 (socket says 172.21.15.16:46618) 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 -- 172.21.15.16:0/2778285075 learned_addr learned my addr 172.21.15.16:0/2778285075 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f32200640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f2c153180 0x7f7f2c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f31800640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0c97e0 0x7f7f2c14da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 -- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f2c153180 msgr2=0x7f7f2c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f2c153180 0x7f7f2c14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 -- 172.21.15.16:0/2778285075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0c97e0 msgr2=0x7f7f2c14da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0c97e0 0x7f7f2c14da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.371+0000 7f7f30e00640 1 -- 172.21.15.16:0/2778285075 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c150340 con 0x7f7f2c0ca790 2024-04-25T10:39:29.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f30e00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801ba90 tx=0x7f7f1801a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180bb030 con 0x7f7f2c0ca790 2024-04-25T10:39:29.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1800a0d0 con 0x7f7f2c0ca790 2024-04-25T10:39:29.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180b1040 con 0x7f7f2c0ca790 2024-04-25T10:39:29.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c14dfc0 con 0x7f7f2c0ca790 2024-04-25T10:39:29.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.379+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c14c6f0 con 0x7f7f2c0ca790 2024-04-25T10:39:29.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.383+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c076d30 con 0x7f7f2c0ca790 2024-04-25T10:39:29.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.383+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7f180be070 con 0x7f7f2c0ca790 2024-04-25T10:39:29.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.387+0000 7f7f29600640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 0x7f7f14071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:29.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.387+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7f181290f0 con 0x7f7f2c0ca790 2024-04-25T10:39:29.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.387+0000 7f7f31800640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 0x7f7f14071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:29.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.387+0000 7f7f31800640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 0x7f7f14071ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c156b00 tx=0x7f7f2400d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:29.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.399+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f180c6020 con 0x7f7f2c0ca790 2024-04-25T10:39:29.619 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.611+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f522c005710 con 0x7f52640077b0 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.615+0000 7f5262000640 1 -- 172.21.15.16:0/2199324899 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f525c05f930 con 0x7f52640077b0 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 msgr2=0x7f5244071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 0x7f5244071ab0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f525801c5d0 tx=0x7f5258008040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 msgr2=0x7f52640d3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 0x7f52640d3c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f525c00e820 tx=0x7f525c00ece0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 shutdown_connections 2024-04-25T10:39:29.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f524406f5a0 0x7f5244071ab0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52640da920 0x7f52640d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52640340b0 0x7f52640cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 --2- 172.21.15.16:0/2199324899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52640077b0 0x7f52640d3c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.623 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.619+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 >> 172.21.15.16:0/2199324899 conn(0x7f5264051080 msgr2=0x7f52640de350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.623+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 shutdown_connections 2024-04-25T10:39:29.626 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.623+0000 7f5271200640 1 -- 172.21.15.16:0/2199324899 wait complete. 2024-04-25T10:39:29.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.623+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9114005a30 con 0x7f9148035210 2024-04-25T10:39:29.629 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.623+0000 7f914cc00640 1 -- 172.21.15.16:0/1905559085 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f913c05c540 con 0x7f9148035210 2024-04-25T10:39:29.629 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 msgr2=0x7f9124071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 0x7f9124071c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9144000fc0 tx=0x7f9144009040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 msgr2=0x7f91480da3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f913c006fd0 tx=0x7f913c00ea10 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 shutdown_connections 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f912406f750 0x7f9124071c60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9148173810 0x7f9148182ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9148035210 0x7f91480da3e0 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f913c006fd0 tx=0x7f913c00ea10 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 --2- 172.21.15.16:0/1905559085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9138009a50 0x7f91480e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 >> 172.21.15.16:0/1905559085 conn(0x7f914800a190 msgr2=0x7f9148051410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 shutdown_connections 2024-04-25T10:39:29.640 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.635+0000 7f9142000640 1 -- 172.21.15.16:0/1905559085 wait complete. 2024-04-25T10:39:29.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-04-25T10:39:29.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-25T10:39:29.669 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.663+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f228c155db0 con 0x7f228c15ee70 2024-04-25T10:39:29.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f2288c00640 1 -- 172.21.15.16:0/1402675430 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f227c05f110 con 0x7f228c15ee70 2024-04-25T10:39:29.670 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6830005710 con 0x7f6870071bd0 2024-04-25T10:39:29.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f6866a00640 1 -- 172.21.15.16:0/2304189481 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6868016740 con 0x7f6870071bd0 2024-04-25T10:39:29.673 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 msgr2=0x7f2264071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 0x7f2264071b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f22840b1000 tx=0x7f22840aa000 comp rx=0 tx=0).stop 2024-04-25T10:39:29.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 msgr2=0x7f228c1f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.667+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f227c00c480 tx=0x7f227c001e80 comp rx=0 tx=0).stop 2024-04-25T10:39:29.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 shutdown_connections 2024-04-25T10:39:29.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f226406f5f0 0x7f2264071b00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f228c15ee70 0x7f228c1f4700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f228c0cbe60 0x7f228c14b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 --2- 172.21.15.16:0/1402675430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f228c0c80b0 0x7f228c149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 >> 172.21.15.16:0/1402675430 conn(0x7f228c073130 msgr2=0x7f228c158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 msgr2=0x7f6848071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 0x7f6848071ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68701646d0 tx=0x7f685c009040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 msgr2=0x7f6870156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68680af040 tx=0x7f68680197d0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 shutdown_connections 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f2293800640 1 -- 172.21.15.16:0/1402675430 wait complete. 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 shutdown_connections 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f684806f5d0 0x7f6848071ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68700c9450 0x7f6870145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700c7c40 0x7f6870153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 --2- 172.21.15.16:0/2304189481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6870071bd0 0x7f6870156a20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 >> 172.21.15.16:0/2304189481 conn(0x7f68700ca620 msgr2=0x7f6870163880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 shutdown_connections 2024-04-25T10:39:29.678 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.671+0000 7f6875400640 1 -- 172.21.15.16:0/2304189481 wait complete. 2024-04-25T10:39:29.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.675+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9f00156150 con 0x7f9f000c4df0 2024-04-25T10:39:29.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.675+0000 7f9ef6000640 1 -- 172.21.15.16:0/612094595 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9eec016230 con 0x7f9f000c4df0 2024-04-25T10:39:29.680 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 msgr2=0x7f9ed8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 0x7f9ed8071ab0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f00164cd0 tx=0x7f9ef0009040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 msgr2=0x7f9f0016b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.684 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 0x7f9f0016b550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9f000b9230 tx=0x7f9eec0193e0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 shutdown_connections 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9ed806f5a0 0x7f9ed8071ab0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f00153fc0 0x7f9f001565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f000c9190 0x7f9f00204030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 --2- 172.21.15.16:0/612094595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f000c4df0 0x7f9f0016b550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 >> 172.21.15.16:0/612094595 conn(0x7f9f000cdc80 msgr2=0x7f9f000cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 shutdown_connections 2024-04-25T10:39:29.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.679+0000 7f9f05200640 1 -- 172.21.15.16:0/612094595 wait complete. 2024-04-25T10:39:29.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.687+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f03cc0059e0 con 0x7f040c0c7c70 2024-04-25T10:39:29.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7d2c005710 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0403400640 1 -- 172.21.15.16:0/3026421212 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f03fc0fe2e0 con 0x7f040c0c7c70 2024-04-25T10:39:29.694 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:29.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f7d62000640 1 -- 172.21.15.16:0/4121240787 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d6405b6d0 con 0x7f7d6c0c7c40 2024-04-25T10:39:29.697 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.697 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 msgr2=0x7f03e4071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 0x7f03e4071cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f040c1518b0 tx=0x7f03f8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 msgr2=0x7f040c15c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f03fc01ab80 tx=0x7f03fc019270 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 shutdown_connections 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f03e406f7a0 0x7f03e4071cb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f040c15b1f0 0x7f040c15d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f040c0c8080 0x7f040c14ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 --2- 172.21.15.16:0/3026421212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f040c0c7c70 0x7f040c15c930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.698 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.691+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 >> 172.21.15.16:0/3026421212 conn(0x7f040c073150 msgr2=0x7f040c15a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 shutdown_connections 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f0412800640 1 -- 172.21.15.16:0/3026421212 wait complete. 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 msgr2=0x7f7d40071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 0x7f7d40071a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800d040 tx=0x7f7d580ab070 comp rx=0 tx=0).stop 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 msgr2=0x7f7d6c155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.699 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 0x7f7d6c155b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d6400c770 tx=0x7f7d6400cc30 comp rx=0 tx=0).stop 2024-04-25T10:39:29.700 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 shutdown_connections 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7d4006f550 0x7f7d40071a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d6c15b9d0 0x7f7d6c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d6c0c97a0 0x7f7d6c135ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 --2- 172.21.15.16:0/4121240787 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d6c0c7c40 0x7f7d6c155b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 >> 172.21.15.16:0/4121240787 conn(0x7f7d6c0cdc80 msgr2=0x7f7d6c1eb330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 shutdown_connections 2024-04-25T10:39:29.701 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.695+0000 7f7d70a00640 1 -- 172.21.15.16:0/4121240787 wait complete. 2024-04-25T10:39:29.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-04-25T10:39:29.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2024-04-25T10:39:29.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7f2c14c970 con 0x7f7f2c0ca790 2024-04-25T10:39:29.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-04-25T10:39:29.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f29600640 1 -- 172.21.15.16:0/2778285075 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7f2c159e40 con 0x7f7f2c0ca790 2024-04-25T10:39:29.723 INFO:teuthology.orchestra.run.smithi016.stdout:55834574858 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 msgr2=0x7f7f14071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 0x7f7f14071ab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c156b00 tx=0x7f7f2400d040 comp rx=0 tx=0).stop 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 msgr2=0x7f7f2c144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801ba90 tx=0x7f7f1801a180 comp rx=0 tx=0).stop 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 shutdown_connections 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f7f1406f5a0 0x7f7f14071ab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f2c153180 0x7f7f2c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f2c0ca790 0x7f7f2c144070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 --2- 172.21.15.16:0/2778285075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f2c0c97e0 0x7f7f2c14da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:29.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 >> 172.21.15.16:0/2778285075 conn(0x7f7f2c071300 msgr2=0x7f7f2c14f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:29.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 shutdown_connections 2024-04-25T10:39:29.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:29.719+0000 7f7f32c00640 1 -- 172.21.15.16:0/2778285075 wait complete. 2024-04-25T10:39:29.729 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-25T10:39:29.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-04-25T10:39:29.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-25T10:39:30.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:39:30.669 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:39:30.705 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:39:30.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:39:30.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:39:30.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:39:30.731 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:39:30.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:39:30.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.863+0000 7f01fbe00640 1 Processor -- start 2024-04-25T10:39:30.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.863+0000 7f01fbe00640 1 -- start start 2024-04-25T10:39:30.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01fbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01fc162120 0x7f01fc164a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01fbe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f01fc06ca80 0x7f01fc16bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01fc162120 0x7f01fc164a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01fbe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01fc164f40 con 0x7f01fc06c670 2024-04-25T10:39:30.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01fbe00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f01fc0b0440 con 0x7f01fc162120 2024-04-25T10:39:30.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f01fc162120 0x7f01fc164a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46896/0 (socket says 172.21.15.16:46896) 2024-04-25T10:39:30.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 -- 172.21.15.16:0/4070968600 learned_addr learned my addr 172.21.15.16:0/4070968600 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:30.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f01fc0c9840 con 0x7f01fc06ca80 2024-04-25T10:39:30.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 -- 172.21.15.16:0/4070968600 >> v2:172.21.15.186:3300/0 conn(0x7f01fc06ca80 msgr2=0x7f01fc16bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:30.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 --2- 172.21.15.16:0/4070968600 >> v2:172.21.15.186:3300/0 conn(0x7f01fc06ca80 0x7f01fc16bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 -- 172.21.15.16:0/4070968600 >> v1:172.21.15.16:6789/0 conn(0x7f01fc06c670 legacy=0x7f01fc0c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.874 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.867+0000 7f01faa00640 1 -- 172.21.15.16:0/4070968600 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc0c9280 con 0x7f01fc162120 2024-04-25T10:39:30.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.875+0000 7f01faa00640 1 --2- 172.21.15.16:0/4070968600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc162120 0x7f01fc164a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01fc161c00 tx=0x7f01ec01c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4596483284640413 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.875+0000 7f01f9600640 1 -- 172.21.15.16:0/4070968600 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0ab640 con 0x7f01fc162120 2024-04-25T10:39:30.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.875+0000 7f01f9600640 1 -- 172.21.15.16:0/4070968600 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec0b0070 con 0x7f01fc162120 2024-04-25T10:39:30.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.875+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc162120 msgr2=0x7f01fc164a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.881 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.875+0000 7f01f9600640 1 -- 172.21.15.16:0/4070968600 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0ab640 con 0x7f01fc162120 2024-04-25T10:39:30.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.879+0000 7f01fbe00640 1 --2- 172.21.15.16:0/4070968600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc162120 0x7f01fc164a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01fc161c00 tx=0x7f01ec01c660 comp rx=0 tx=0).stop 2024-04-25T10:39:30.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.879+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 shutdown_connections 2024-04-25T10:39:30.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.879+0000 7f01fbe00640 1 --2- 172.21.15.16:0/4070968600 >> v2:172.21.15.186:3300/0 conn(0x7f01fc06ca80 0x7f01fc16bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.879+0000 7f01fbe00640 1 --2- 172.21.15.16:0/4070968600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc162120 0x7f01fc164a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.879+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 >> 172.21.15.16:0/4070968600 conn(0x7f01fc0c9cf0 msgr2=0x7f01fc0ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:30.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.887+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 shutdown_connections 2024-04-25T10:39:30.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.887+0000 7f01fbe00640 1 -- 172.21.15.16:0/4070968600 wait complete. 2024-04-25T10:39:30.894 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.891+0000 7f01fbe00640 1 Processor -- start 2024-04-25T10:39:30.895 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.891+0000 7f01fbe00640 1 -- start start 2024-04-25T10:39:30.898 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01fc06ca80 0x7f01fc158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01faa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01faa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46906/0 (socket says 172.21.15.16:46906) 2024-04-25T10:39:30.899 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01faa00640 1 -- 172.21.15.16:0/2967924154 learned_addr learned my addr 172.21.15.16:0/2967924154 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:30.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01fc162120 0x7f01fc164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc0c8eb0 con 0x7f01fc06c670 2024-04-25T10:39:30.900 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fa000640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01fc06ca80 0x7f01fc158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fb400640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01fc162120 0x7f01fc164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f01fc06cf10 con 0x7f01fc06ca80 2024-04-25T10:39:30.901 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.895+0000 7f01fbe00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f01fc0c9030 con 0x7f01fc162120 2024-04-25T10:39:30.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 -- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01fc162120 msgr2=0x7f01fc164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01fc162120 0x7f01fc164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.902 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 -- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01fc06ca80 msgr2=0x7f01fc158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01fc06ca80 0x7f01fc158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01fc158b70 con 0x7f01fc06c670 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01faa00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01ec019290 tx=0x7f01ec019420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec003db0 con 0x7f01fc06c670 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec0bd070 con 0x7f01fc06c670 2024-04-25T10:39:30.903 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0ab640 con 0x7f01fc06c670 2024-04-25T10:39:30.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01fbe00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01fc1f9900 con 0x7f01fc06c670 2024-04-25T10:39:30.905 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.899+0000 7f01fbe00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01fc163510 con 0x7f01fc06c670 2024-04-25T10:39:30.910 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.907+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f01ec0ab860 con 0x7f01fc06c670 2024-04-25T10:39:30.913 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.907+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01fc076d30 con 0x7f01fc06c670 2024-04-25T10:39:30.914 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.907+0000 7f01f2a00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 0x7f01d0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.911+0000 7f01fa000640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 0x7f01d0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.911+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f01ec12d120 con 0x7f01fc06c670 2024-04-25T10:39:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.911+0000 7f01fa000640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 0x7f01d0071a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01fc20c4e0 tx=0x7f01e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.919+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01ec016270 con 0x7f01fc06c670 2024-04-25T10:39:30.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.943+0000 7f5087a00640 1 Processor -- start 2024-04-25T10:39:30.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.943+0000 7f5087a00640 1 -- start start 2024-04-25T10:39:30.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f5087a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f508016a8e0 0x7f50801640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f5087a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50800cc5b0 con 0x7f508016c410 2024-04-25T10:39:30.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f5087a00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508016acf0 con 0x7f508008d3f0 2024-04-25T10:39:30.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f5087a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f50800cc370 con 0x7f508016a8e0 2024-04-25T10:39:30.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f507fe00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f508008d3f0 0x7f508016bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45364/0 (socket says 172.21.15.16:45364) 2024-04-25T10:39:30.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f507fe00640 1 -- 172.21.15.16:0/2538256752 learned_addr learned my addr 172.21.15.16:0/2538256752 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:30.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.947+0000 7f5085000640 1 --2- 172.21.15.16:0/2538256752 >> v2:172.21.15.16:3300/0 conn(0x7f508016a8e0 0x7f50801640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.951+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851437078 0 0) 0x7f50800cc5b0 con 0x7f508016c410 2024-04-25T10:39:30.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.951+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50600035c0 con 0x7f508016c410 2024-04-25T10:39:30.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.951+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073949745 0 0) 0x7f508016acf0 con 0x7f508008d3f0 2024-04-25T10:39:30.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.951+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50800cc5b0 con 0x7f508008d3f0 2024-04-25T10:39:30.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3838498746 0 0) 0x7f50600035c0 con 0x7f508016c410 2024-04-25T10:39:30.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 >> v2:172.21.15.16:3300/0 conn(0x7f508016a8e0 msgr2=0x7f50801640c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:30.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 --2- 172.21.15.16:0/2538256752 >> v2:172.21.15.16:3300/0 conn(0x7f508016a8e0 0x7f50801640c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 >> v1:172.21.15.186:6789/0 conn(0x7f508008d3f0 legacy=0x7f508016bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50800cc870 con 0x7f508016c410 2024-04-25T10:39:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f5078001a90 con 0x7f508016c410 2024-04-25T10:39:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 >> v1:172.21.15.16:6789/0 conn(0x7f508016c410 legacy=0x7f5080174650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 0x7f5060005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5060003840 0x7f5060003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f630a200640 1 Processor -- start 2024-04-25T10:39:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5060004190 0x7f506000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f50800cc370 con 0x7f5060004c40 2024-04-25T10:39:30.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f630a200640 1 -- start start 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f506000c0b0 con 0x7f5060004190 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f506000c2b0 con 0x7f5060003840 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085a00640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5060004190 0x7f506000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 0x7f5060005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f507fe00640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5060003840 0x7f5060003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 -- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5060003840 msgr2=0x7f5060003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5060003840 0x7f5060003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 -- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5060004190 msgr2=0x7f506000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:30.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5060004190 0x7f506000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.955+0000 7f5085000640 1 -- 172.21.15.16:0/2538256752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50800cc870 con 0x7f5060004c40 2024-04-25T10:39:30.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f5085a00640 1 -- 172.21.15.16:0/2538256752 reap_dead start 2024-04-25T10:39:30.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f630a200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63041648d0 0x7f6304166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f630415b9d0 0x7f63040c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38524/0 (socket says 172.21.15.16:38524) 2024-04-25T10:39:30.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302a00640 1 -- 172.21.15.16:0/1333259395 learned_addr learned my addr 172.21.15.16:0/1333259395 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:30.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6303400640 1 --1- 172.21.15.16:0/1333259395 >> v1:172.21.15.186:6789/0 conn(0x7f63040c7c40 0x7f63040c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45366/0 (socket says 172.21.15.16:45366) 2024-04-25T10:39:30.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6303e00640 1 --2- 172.21.15.16:0/1333259395 >> v2:172.21.15.16:3300/0 conn(0x7f63041648d0 0x7f6304166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63040b8f60 con 0x7f630415b9d0 2024-04-25T10:39:30.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f5085000640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 0x7f5060005050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5070009b10 tx=0x7f507001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a958f4bcf8f63088 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581710863 0 0) 0x7f63040b8f60 con 0x7f630415b9d0 2024-04-25T10:39:30.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b2070 con 0x7f5060004c40 2024-04-25T10:39:30.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63040b9220 con 0x7f63040c7c40 2024-04-25T10:39:30.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50700a56f0 con 0x7f5060004c40 2024-04-25T10:39:30.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f63040b9ac0 con 0x7f63041648d0 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e40035c0 con 0x7f630415b9d0 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536539872 0 0) 0x7f63040b9220 con 0x7f63040c7c40 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63040b8f60 con 0x7f63040c7c40 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6303e00640 1 -- 172.21.15.16:0/1333259395 >> v1:172.21.15.186:6789/0 conn(0x7f63040c7c40 legacy=0x7f63040c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6303e00640 1 -- 172.21.15.16:0/1333259395 >> v1:172.21.15.16:6789/0 conn(0x7f630415b9d0 legacy=0x7f63040c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f6303e00640 1 -- 172.21.15.16:0/1333259395 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63040b9500 con 0x7f63041648d0 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f5087a00640 1 -- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 msgr2=0x7f5060005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f507f400640 1 -- 172.21.15.16:0/2538256752 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b2070 con 0x7f5060004c40 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.963+0000 7f5087a00640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 0x7f5060005050 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5070009b10 tx=0x7f507001caf0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.967+0000 7f5087a00640 1 -- 172.21.15.16:0/2538256752 shutdown_connections 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.967+0000 7f5087a00640 1 --2- 172.21.15.16:0/2538256752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5060004c40 0x7f5060005050 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.967+0000 7f5087a00640 1 -- 172.21.15.16:0/2538256752 >> 172.21.15.16:0/2538256752 conn(0x7f50800d19d0 msgr2=0x7f50800d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.967+0000 7f5087a00640 1 -- 172.21.15.16:0/2538256752 shutdown_connections 2024-04-25T10:39:30.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.967+0000 7f5087a00640 1 -- 172.21.15.16:0/2538256752 wait complete. 2024-04-25T10:39:30.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.971+0000 7f5087a00640 1 Processor -- start 2024-04-25T10:39:30.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.975+0000 7f5087a00640 1 -- start start 2024-04-25T10:39:30.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.975+0000 7f6303e00640 1 --2- 172.21.15.16:0/1333259395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63041648d0 0x7f6304166cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009ee0 tx=0x7f62fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189030a8e294e6b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.975+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0b2070 con 0x7f63041648d0 2024-04-25T10:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62fc0a5930 con 0x7f63041648d0 2024-04-25T10:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f6302000640 1 -- 172.21.15.16:0/1333259395 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0a5d00 con 0x7f63041648d0 2024-04-25T10:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50801f6c90 0x7f50801f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f508016b220 con 0x7f50800c4990 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f50800cce30 con 0x7f50801f6c90 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5087a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f508016b500 con 0x7f5080205e50 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507fe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46940/0 (socket says 172.21.15.16:46940) 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507fe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46650/0 (socket says 172.21.15.16:46650) 2024-04-25T10:39:30.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 -- 172.21.15.16:0/2952890138 learned_addr learned my addr 172.21.15.16:0/2952890138 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 -- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 msgr2=0x7f50800c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 -- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50801f6c90 msgr2=0x7f50801f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50801f6c90 0x7f50801f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 -- 172.21.15.16:0/2952890138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50800cab30 con 0x7f50800c4990 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507fe00640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:30.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f5085000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f507001d390 tx=0x7f5070019890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50700b2040 con 0x7f50800c4990 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50700bd070 con 0x7f50800c4990 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.979+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070009710 con 0x7f50800c4990 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f5087a00640 1 -- 172.21.15.16:0/2952890138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50800cae10 con 0x7f50800c4990 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f5087a00640 1 -- 172.21.15.16:0/2952890138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50800c8a00 con 0x7f50800c4990 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63041648d0 msgr2=0x7f6304166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 --2- 172.21.15.16:0/1333259395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63041648d0 0x7f6304166cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009ee0 tx=0x7f62fc01c9a0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 shutdown_connections 2024-04-25T10:39:30.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 --2- 172.21.15.16:0/1333259395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63041648d0 0x7f6304166cf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 >> 172.21.15.16:0/1333259395 conn(0x7f63040cdc80 msgr2=0x7f63040c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:30.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.987+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5080050750 con 0x7f50800c4990 2024-04-25T10:39:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.987+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50700b8910 con 0x7f50800c4990 2024-04-25T10:39:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 shutdown_connections 2024-04-25T10:39:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.983+0000 7f630a200640 1 -- 172.21.15.16:0/1333259395 wait complete. 2024-04-25T10:39:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.987+0000 7f630a200640 1 Processor -- start 2024-04-25T10:39:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.987+0000 7f630a200640 1 -- start start 2024-04-25T10:39:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f507cc00640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 0x7f5058071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f50701298f0 con 0x7f50800c4990 2024-04-25T10:39:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 0x7f630420c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6303400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 0x7f630420c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46956/0 (socket says 172.21.15.16:46956) 2024-04-25T10:39:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 -- 172.21.15.16:0/2089339997 learned_addr learned my addr 172.21.15.16:0/2089339997 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63041648d0 0x7f630415d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f63040c82d0 con 0x7f630415b9d0 2024-04-25T10:39:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f63040c8150 con 0x7f63041648d0 2024-04-25T10:39:30.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f63040c7000 con 0x7f63040c7c40 2024-04-25T10:39:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6303e00640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63041648d0 0x7f630415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:30.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 -- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 msgr2=0x7f630420c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 0x7f630420c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 -- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63041648d0 msgr2=0x7f630415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63041648d0 0x7f630415d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.991+0000 7f6302a00640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63041f2370 con 0x7f630415b9d0 2024-04-25T10:39:30.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.995+0000 7f507fe00640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 0x7f5058071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.995+0000 7f6302a00640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c560 tx=0x7f62f400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.995+0000 7f6303400640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 0x7f630420c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.995+0000 7f507fe00640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 0x7f5058071ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f506c007aa0 tx=0x7f506c007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:30.999+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4018070 con 0x7f630415b9d0 2024-04-25T10:39:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63041f3470 con 0x7f630415b9d0 2024-04-25T10:39:31.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63041f3a30 con 0x7f630415b9d0 2024-04-25T10:39:31.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50700c6020 con 0x7f50800c4990 2024-04-25T10:39:31.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f40074e0 con 0x7f630415b9d0 2024-04-25T10:39:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4022060 con 0x7f630415b9d0 2024-04-25T10:39:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.003+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c4005420 con 0x7f630415b9d0 2024-04-25T10:39:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.007+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f62f401b070 con 0x7f630415b9d0 2024-04-25T10:39:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.011+0000 7f62fb400640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 0x7f62d8071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.011+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f62f408e9c0 con 0x7f630415b9d0 2024-04-25T10:39:31.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.011+0000 7f6303400640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 0x7f62d8071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.019+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62f405ae90 con 0x7f630415b9d0 2024-04-25T10:39:31.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.019+0000 7f6303400640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 0x7f62d8071a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f62f00012c0 tx=0x7f62f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.023+0000 7fa79bc00640 1 Processor -- start 2024-04-25T10:39:31.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.023+0000 7fa79bc00640 1 -- start start 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa79bc00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa79415b8a0 0x7fa794165000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa79bc00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa794165540 0x7fa79416be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa79bc00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7940cae00 con 0x7fa7940cdb20 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa79bc00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa794164b70 con 0x7fa79415b8a0 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa79bc00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa7940b67a0 con 0x7fa794165540 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa799200640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa7940cdb20 0x7fa79408d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45372/0 (socket says 172.21.15.16:45372) 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa799200640 1 -- 172.21.15.16:0/2721257814 learned_addr learned my addr 172.21.15.16:0/2721257814 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa793e00640 1 --2- 172.21.15.16:0/2721257814 >> v2:172.21.15.186:3300/0 conn(0x7fa79415b8a0 0x7fa794165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.027+0000 7fa799c00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa794165540 0x7fa79416be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fa793e00640 1 -- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa794165540 msgr2=0x7fa79416be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fa793e00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa794165540 0x7fa79416be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fa793400640 1 -- 172.21.15.16:0/2721257814 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059040656 0 0) 0x7fa7940cae00 con 0x7fa7940cdb20 2024-04-25T10:39:31.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fa793e00640 1 -- 172.21.15.16:0/2721257814 >> v1:172.21.15.186:6789/0 conn(0x7fa7940cdb20 legacy=0x7fa79408d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fa793e00640 1 -- 172.21.15.16:0/2721257814 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79415bcb0 con 0x7fa79415b8a0 2024-04-25T10:39:31.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fd723a00640 1 Processor -- start 2024-04-25T10:39:31.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.031+0000 7fd723a00640 1 -- start start 2024-04-25T10:39:31.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd71c0c7c40 0x7fd71c153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c071bd0 0x7fd71c0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fa793e00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa79415b8a0 0x7fa794165000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa788009900 tx=0x7fa78801ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d67842df8922c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 0x7fd71c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd721000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd71c0c7c40 0x7fd71c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd721000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd71c0c7c40 0x7fd71c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33562/0 (socket says 172.21.15.16:33562) 2024-04-25T10:39:31.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fa793400640 1 -- 172.21.15.16:0/2721257814 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7880b5070 con 0x7fa79415b8a0 2024-04-25T10:39:31.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd721a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 0x7fd71c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd721a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 0x7fd71c070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46968/0 (socket says 172.21.15.16:46968) 2024-04-25T10:39:31.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd721000640 1 -- 172.21.15.16:0/1939273344 learned_addr learned my addr 172.21.15.16:0/1939273344 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fa793400640 1 -- 172.21.15.16:0/2721257814 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7880a8a90 con 0x7fa79415b8a0 2024-04-25T10:39:31.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fa793400640 1 -- 172.21.15.16:0/2721257814 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7880a8e60 con 0x7fa79415b8a0 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c1539b0 con 0x7fd71c0708d0 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd71c0c6a20 con 0x7fd71c0c7c40 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd71c15a060 con 0x7fd71c071bd0 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.035+0000 7fd71be00640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c071bd0 0x7fd71c0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fd721000640 1 -- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c071bd0 msgr2=0x7fd71c0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fd721000640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c071bd0 0x7fd71c0c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fd721000640 1 -- 172.21.15.16:0/1939273344 >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 msgr2=0x7fd71c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fd721000640 1 --2- 172.21.15.16:0/1939273344 >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 0x7fd71c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fd721000640 1 -- 172.21.15.16:0/1939273344 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c0c50a0 con 0x7fd71c0c7c40 2024-04-25T10:39:31.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 -- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa79415b8a0 msgr2=0x7fa794165000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa79415b8a0 0x7fa794165000 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa788009900 tx=0x7fa78801ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:31.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 -- 172.21.15.16:0/2721257814 shutdown_connections 2024-04-25T10:39:31.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa794165540 0x7fa79416be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 --2- 172.21.15.16:0/2721257814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa79415b8a0 0x7fa794165000 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 -- 172.21.15.16:0/2721257814 >> 172.21.15.16:0/2721257814 conn(0x7fa7940d19d0 msgr2=0x7fa7940d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 -- 172.21.15.16:0/2721257814 shutdown_connections 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7fa79bc00640 1 -- 172.21.15.16:0/2721257814 wait complete. 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7f80b1200640 1 Processor -- start 2024-04-25T10:39:31.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.039+0000 7f80b1200640 1 -- start start 2024-04-25T10:39:31.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fab7e400640 1 Processor -- start 2024-04-25T10:39:31.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fab7e400640 1 -- start start 2024-04-25T10:39:31.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fa79bc00640 1 Processor -- start 2024-04-25T10:39:31.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fa79bc00640 1 -- start start 2024-04-25T10:39:31.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80b1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 0x7f80ac0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fd721000640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0c7c40 0x7fd71c153470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0cad80 tx=0x7fd70c01c5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de2b1c2b47e3db74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80b1200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fd71b400640 1 -- 172.21.15.16:0/1939273344 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b0070 con 0x7fd71c0c7c40 2024-04-25T10:39:31.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fd71b400640 1 -- 172.21.15.16:0/1939273344 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0ab600 con 0x7fd71c0c7c40 2024-04-25T10:39:31.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7fd71b400640 1 -- 172.21.15.16:0/1939273344 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b0070 con 0x7fd71c0c7c40 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80a9400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80a9400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46692/0 (socket says 172.21.15.16:46692) 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80a9400640 1 -- 172.21.15.16:0/700294027 learned_addr learned my addr 172.21.15.16:0/700294027 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ac0c5b00 con 0x7f80ac15d3e0 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f80ac1545f0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.043+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f80ac0ca130 con 0x7f80ac06d780 2024-04-25T10:39:31.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9e00640 1 --2- 172.21.15.16:0/700294027 >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 0x7f80ac0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9400640 1 -- 172.21.15.16:0/700294027 >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 msgr2=0x7f80ac0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9400640 1 --2- 172.21.15.16:0/700294027 >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 0x7f80ac0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab7e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab7e400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 0x7fab78167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab7e400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7815d1b0 con 0x7fab7806d830 2024-04-25T10:39:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab7e400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fab7806ecf0 con 0x7fab78165ac0 2024-04-25T10:39:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab7e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fab7806efd0 con 0x7fab780c6e50 2024-04-25T10:39:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0c7c40 msgr2=0x7fd71c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0c7c40 0x7fd71c153470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0cad80 tx=0x7fd70c01c5b0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9400640 1 -- 172.21.15.16:0/700294027 >> v1:172.21.15.186:6789/0 conn(0x7f80ac15d3e0 legacy=0x7f80ac15d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 shutdown_connections 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 --2- 172.21.15.16:0/1939273344 >> v2:172.21.15.16:3300/0 conn(0x7fd71c0708d0 0x7fd71c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c071bd0 0x7fd71c0c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 --2- 172.21.15.16:0/1939273344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0c7c40 0x7fd71c153470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9400640 1 -- 172.21.15.16:0/700294027 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac0ca410 con 0x7f80ac06d780 2024-04-25T10:39:31.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 >> 172.21.15.16:0/1939273344 conn(0x7fd71c0ca620 msgr2=0x7fd71c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7f80a9e00640 1 --2- 172.21.15.16:0/700294027 >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 0x7f80ac0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:31.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 shutdown_connections 2024-04-25T10:39:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fd723a00640 1 -- 172.21.15.16:0/1939273344 wait complete. 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46702/0 (socket says 172.21.15.16:46702) 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 -- 172.21.15.16:0/2544636498 learned_addr learned my addr 172.21.15.16:0/2544636498 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab77e00640 1 --2- 172.21.15.16:0/2544636498 >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 0x7fab78167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 -- 172.21.15.16:0/2544636498 >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 msgr2=0x7fab78167ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 --2- 172.21.15.16:0/2544636498 >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 0x7fab78167ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 -- 172.21.15.16:0/2544636498 >> v1:172.21.15.16:6789/0 conn(0x7fab7806d830 legacy=0x7fab780cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab76a00640 1 -- 172.21.15.16:0/2544636498 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7806f2b0 con 0x7fab780c6e50 2024-04-25T10:39:31.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.047+0000 7fab77e00640 1 --2- 172.21.15.16:0/2544636498 >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 0x7fab78167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 0x7fa794158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 0x7fa7941ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa7940cb630 con 0x7fa7940cdb20 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa7940cb350 con 0x7fa794165540 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa7940cb910 con 0x7fa79415b8a0 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa793e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 0x7fa7941ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33570/0 (socket says 172.21.15.16:33570) 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa793e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 0x7fa7941ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46716/0 (socket says 172.21.15.16:46716) 2024-04-25T10:39:31.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 -- 172.21.15.16:0/1743780684 learned_addr learned my addr 172.21.15.16:0/1743780684 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7ffbd7a00640 1 Processor -- start 2024-04-25T10:39:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799200640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 0x7fa794158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 -- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 msgr2=0x7fa7941ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 0x7fa7941ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 -- 172.21.15.16:0/1743780684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 msgr2=0x7fa794158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7ffbd7a00640 1 -- start start 2024-04-25T10:39:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 0x7fa794158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 -- 172.21.15.16:0/1743780684 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7941edd00 con 0x7fa794165540 2024-04-25T10:39:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799200640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 0x7fa794158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7f80a9400640 1 --2- 172.21.15.16:0/700294027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f809800ddf0 tx=0x7f809801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce2f1705b29beac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa799c00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00edb0 tx=0x7fa78c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c018020 con 0x7fa794165540 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7941ed2e0 con 0x7fa794165540 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79415d5c0 con 0x7fa794165540 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78c014480 con 0x7fa794165540 2024-04-25T10:39:31.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c014870 con 0x7fa794165540 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7f80a8a00640 1 -- 172.21.15.16:0/700294027 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809800d2d0 con 0x7f80ac06d780 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.051+0000 7f80a8a00640 1 -- 172.21.15.16:0/700294027 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809800b450 con 0x7f80ac06d780 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7f80a8a00640 1 -- 172.21.15.16:0/700294027 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809800d2d0 con 0x7f80ac06d780 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c005420 con 0x7fa794165540 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 msgr2=0x7f80ac06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7f80b1200640 1 --2- 172.21.15.16:0/700294027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f809800ddf0 tx=0x7f809801c500 comp rx=0 tx=0).stop 2024-04-25T10:39:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fd723a00640 1 Processor -- start 2024-04-25T10:39:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fd723a00640 1 -- start start 2024-04-25T10:39:31.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd7a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffbd00c82b0 0x7ffbd01550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd7a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 0x7ffbd006e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd5000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffbd00c82b0 0x7ffbd01550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd5000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffbd00c82b0 0x7ffbd01550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33586/0 (socket says 172.21.15.16:33586) 2024-04-25T10:39:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd5000640 1 -- 172.21.15.16:0/1220545033 learned_addr learned my addr 172.21.15.16:0/1220545033 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fab76a00640 1 --2- 172.21.15.16:0/2544636498 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab640099d0 tx=0x7fab6401ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f174227c3b8d62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd006d370 con 0x7ffbd00c6080 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd00c7c60 con 0x7ffbd015b8f0 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd00c56e0 con 0x7ffbd00c82b0 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fab76000640 1 -- 172.21.15.16:0/2544636498 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640b5070 con 0x7fab780c6e50 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fab76000640 1 -- 172.21.15.16:0/2544636498 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab640a8b70 con 0x7fab780c6e50 2024-04-25T10:39:31.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fab76000640 1 -- 172.21.15.16:0/2544636498 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640b0440 con 0x7fab780c6e50 2024-04-25T10:39:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa78c01b020 con 0x7fa794165540 2024-04-25T10:39:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbcfe00640 1 --2- 172.21.15.16:0/1220545033 >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 0x7ffbd006e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd5000640 1 -- 172.21.15.16:0/1220545033 >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 msgr2=0x7ffbd006e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:31.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 shutdown_connections 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7f80b1200640 1 --2- 172.21.15.16:0/700294027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac06d780 0x7f80ac06db90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7f80b1200640 1 --2- 172.21.15.16:0/700294027 >> v2:172.21.15.16:3300/0 conn(0x7f80ac15a8c0 0x7f80ac0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.055+0000 7ffbd5000640 1 --2- 172.21.15.16:0/1220545033 >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 0x7ffbd006e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7ffbd5000640 1 -- 172.21.15.16:0/1220545033 >> v1:172.21.15.186:6789/0 conn(0x7ffbd00c6080 legacy=0x7ffbd015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7ffbd5000640 1 -- 172.21.15.16:0/1220545033 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd006d650 con 0x7ffbd00c82b0 2024-04-25T10:39:31.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 >> 172.21.15.16:0/700294027 conn(0x7f80ac072950 msgr2=0x7f80ac0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7ffbcfe00640 1 --2- 172.21.15.16:0/1220545033 >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 0x7ffbd006e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 shutdown_connections 2024-04-25T10:39:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd71c071bd0 0x7fd71c1fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c0c7c40 0x7fd71c0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c0c6680 con 0x7fd71c071bd0 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd71c0c5c20 con 0x7fd71c0708d0 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd723a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd71c159c80 con 0x7fd71c0c7c40 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 -- 172.21.15.16:0/2544636498 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 msgr2=0x7fab780c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 --2- 172.21.15.16:0/2544636498 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab640099d0 tx=0x7fab6401ee70 comp rx=0 tx=0).stop 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 -- 172.21.15.16:0/2544636498 shutdown_connections 2024-04-25T10:39:31.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 --2- 172.21.15.16:0/2544636498 >> v2:172.21.15.16:3300/0 conn(0x7fab78165ac0 0x7fab78167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 --2- 172.21.15.16:0/2544636498 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab780c6e50 0x7fab780c7260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 -- 172.21.15.16:0/2544636498 >> 172.21.15.16:0/2544636498 conn(0x7fab78073130 msgr2=0x7fab78073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7f80b1200640 1 -- 172.21.15.16:0/700294027 wait complete. 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33596/0 (socket says 172.21.15.16:33596) 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 -- 172.21.15.16:0/775899339 learned_addr learned my addr 172.21.15.16:0/775899339 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd71be00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd71c071bd0 0x7fd71c1fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c0c7c40 0x7fd71c0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 -- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c0c7c40 msgr2=0x7fd71c0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c0c7c40 0x7fd71c0cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 -- 172.21.15.16:0/775899339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd71c071bd0 msgr2=0x7fd71c1fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd71c071bd0 0x7fd71c1fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 -- 172.21.15.16:0/775899339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71c0cc190 con 0x7fd71c0708d0 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 -- 172.21.15.16:0/2544636498 shutdown_connections 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fab7e400640 1 -- 172.21.15.16:0/2544636498 wait complete. 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fd721000640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0ae040 tx=0x7fd70c01adf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fa790c00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 0x7fa770071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa78c090790 con 0x7fa794165540 2024-04-25T10:39:31.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.059+0000 7fa799200640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 0x7fa770071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 Processor -- start 2024-04-25T10:39:31.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7fa799200640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 0x7fa770071ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7940cdab0 tx=0x7fa780008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 -- start start 2024-04-25T10:39:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7ffbd5000640 1 --2- 172.21.15.16:0/1220545033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd01550c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00cbdf0 tx=0x7ffbbc01ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df15b002956f69b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 0x7f80ac0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 0x7f80ac155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7fab7e400640 1 Processor -- start 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac15d3e0 0x7f80ac15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac0ca770 con 0x7f80ac15a8c0 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f80ac0c3f20 con 0x7f80ac06d780 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80b1200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f80ac15acd0 con 0x7f80ac15d3e0 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 0x7f80ac0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 0x7f80ac0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33612/0 (socket says 172.21.15.16:33612) 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9e00640 1 -- 172.21.15.16:0/977629664 learned_addr learned my addr 172.21.15.16:0/977629664 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7fab7e400640 1 -- start start 2024-04-25T10:39:31.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 0x7f80ac155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 -- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac15d3e0 msgr2=0x7f80ac15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac15d3e0 0x7f80ac15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 -- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 msgr2=0x7f80ac0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 0x7f80ac0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.063+0000 7f80a9400640 1 -- 172.21.15.16:0/977629664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ac0cd1a0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80a9400640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 0x7f80ac155fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f80980aa000 tx=0x7f80980192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80980bb070 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80980b7650 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809800d2d0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ac1f8580 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ac1f82a0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 0x7fab781fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ac0c6eb0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab77400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 0x7fab781fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab77400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 0x7fab781fcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47002/0 (socket says 172.21.15.16:47002) 2024-04-25T10:39:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 0x7fab780c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fab78154390 con 0x7fab7806d830 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fab780c6930 con 0x7fab780c6e50 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab7e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fab7806e990 con 0x7fab78165ac0 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33624/0 (socket says 172.21.15.16:33624) 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 -- 172.21.15.16:0/1923476302 learned_addr learned my addr 172.21.15.16:0/1923476302 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab77e00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 0x7fab780c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 -- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 msgr2=0x7fab780c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 0x7fab780c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 -- 172.21.15.16:0/1923476302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 msgr2=0x7fab781fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 0x7fab781fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 -- 172.21.15.16:0/1923476302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab781fd0b0 con 0x7fab780c6e50 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab77e00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 0x7fab780c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.067+0000 7fab76a00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab640b3040 tx=0x7fab6401bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f80980b7b00 con 0x7f80ac15a8c0 2024-04-25T10:39:31.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0ba020 con 0x7fd71c0708d0 2024-04-25T10:39:31.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640b5040 con 0x7fab780c6e50 2024-04-25T10:39:31.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0b4640 con 0x7fd71c0708d0 2024-04-25T10:39:31.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b0070 con 0x7fd71c0708d0 2024-04-25T10:39:31.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7f80a2000640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 0x7f8084071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8098129b50 con 0x7f80ac15a8c0 2024-04-25T10:39:31.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa78c022030 con 0x7fa794165540 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71c200520 con 0x7fd71c0708d0 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71c141fe0 con 0x7fd71c0708d0 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fab7e400640 1 -- 172.21.15.16:0/1923476302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7815ff10 con 0x7fab780c6e50 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fab7e400640 1 -- 172.21.15.16:0/1923476302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab78151960 con 0x7fab780c6e50 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab640be070 con 0x7fab780c6e50 2024-04-25T10:39:31.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab640b9420 con 0x7fab780c6e50 2024-04-25T10:39:31.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.071+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0005420 con 0x7fd71c0708d0 2024-04-25T10:39:31.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7f80a9e00640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 0x7f8084071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7ffbcf400640 1 -- 172.21.15.16:0/1220545033 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b5070 con 0x7ffbd00c82b0 2024-04-25T10:39:31.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7ffbcf400640 1 -- 172.21.15.16:0/1220545033 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc0a8b30 con 0x7ffbd00c82b0 2024-04-25T10:39:31.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7ffbcf400640 1 -- 172.21.15.16:0/1220545033 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b0440 con 0x7ffbd00c82b0 2024-04-25T10:39:31.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7f80a9e00640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 0x7f8084071b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f809c00fbc0 tx=0x7f809c011040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd70c0bd020 con 0x7fd71c0708d0 2024-04-25T10:39:31.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.075+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab34005470 con 0x7fab780c6e50 2024-04-25T10:39:31.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab64004020 con 0x7fab780c6e50 2024-04-25T10:39:31.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fd718c00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 0x7fd6f4071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd70c0f2520 con 0x7fd71c0708d0 2024-04-25T10:39:31.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fab6f400640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 0x7fab50071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fab6412dbc0 con 0x7fab780c6e50 2024-04-25T10:39:31.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 msgr2=0x7ffbd01550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/1220545033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd01550c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00cbdf0 tx=0x7ffbbc01ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:31.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fab77400640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 0x7fab50071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.085 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fd71be00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 0x7fd6f4071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 shutdown_connections 2024-04-25T10:39:31.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/1220545033 >> v2:172.21.15.16:3300/0 conn(0x7ffbd015b8f0 0x7ffbd006e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/1220545033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd01550c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 >> 172.21.15.16:0/1220545033 conn(0x7ffbd0072950 msgr2=0x7ffbd00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 shutdown_connections 2024-04-25T10:39:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7ffbd7a00640 1 -- 172.21.15.16:0/1220545033 wait complete. 2024-04-25T10:39:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80ac0c6eb0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fd71be00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 0x7fd6f4071ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0cc820 tx=0x7fd71400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.079+0000 7fab77400640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 0x7fab50071ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab68007fd0 tx=0x7fab68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 Processor -- start 2024-04-25T10:39:31.088 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 -- start start 2024-04-25T10:39:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd0148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffbd015b8f0 0x7ffbd0143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd006e820 con 0x7ffbd00c6080 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd00c5ca0 con 0x7ffbd00c82b0 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.083+0000 7ffbd7a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffbd00c8c60 con 0x7ffbd015b8f0 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47018/0 (socket says 172.21.15.16:47018) 2024-04-25T10:39:31.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 -- 172.21.15.16:0/194654951 learned_addr learned my addr 172.21.15.16:0/194654951 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 -- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffbd015b8f0 msgr2=0x7ffbd0143110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffbd015b8f0 0x7ffbd0143110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 -- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 msgr2=0x7ffbd0148c80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbcfe00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd0148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd0148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 -- 172.21.15.16:0/194654951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd0145350 con 0x7ffbd00c6080 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd5000640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01ba40 tx=0x7ffbbc01bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.091 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b5040 con 0x7ffbd00c6080 2024-04-25T10:39:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc0be070 con 0x7ffbd00c6080 2024-04-25T10:39:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd014cbc0 con 0x7ffbd00c6080 2024-04-25T10:39:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0b9660 con 0x7ffbd00c6080 2024-04-25T10:39:31.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd014d180 con 0x7ffbd00c6080 2024-04-25T10:39:31.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.087+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd70c0c4030 con 0x7fd71c0708d0 2024-04-25T10:39:31.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.091+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffbbc004020 con 0x7ffbd00c6080 2024-04-25T10:39:31.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.091+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb94005420 con 0x7ffbd00c6080 2024-04-25T10:39:31.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.091+0000 7ffbccc00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 0x7ffbac071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.096 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.091+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffbbc12d090 con 0x7ffbd00c6080 2024-04-25T10:39:31.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.095+0000 7ffbcfe00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 0x7ffbac071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.095+0000 7ffbcfe00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 0x7ffbac071ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0150850 tx=0x7ffbc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.106 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.103+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbbc0c8020 con 0x7ffbd00c6080 2024-04-25T10:39:31.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.107+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab640c8020 con 0x7fab780c6e50 2024-04-25T10:39:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.255+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f01fc163750 con 0x7f01fc06c670 2024-04-25T10:39:31.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.255+0000 7f01f2a00640 1 -- 172.21.15.16:0/2967924154 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01ec0f65c0 con 0x7f01fc06c670 2024-04-25T10:39:31.263 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 msgr2=0x7f01d0071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 0x7f01d0071a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01fc20c4e0 tx=0x7f01e8009040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 msgr2=0x7f01fc0cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f01ec019290 tx=0x7f01ec019420 comp rx=0 tx=0).stop 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 shutdown_connections 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f01d006f520 0x7f01d0071a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f01fc162120 0x7f01fc164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01fc06ca80 0x7f01fc158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 --2- 172.21.15.16:0/2967924154 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f01fc06c670 0x7f01fc0cc850 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.259+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 >> 172.21.15.16:0/2967924154 conn(0x7f01fc0c9cf0 msgr2=0x7f01fc158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.263+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 shutdown_connections 2024-04-25T10:39:31.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.263+0000 7f01e7e00640 1 -- 172.21.15.16:0/2967924154 wait complete. 2024-04-25T10:39:31.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-25T10:39:31.299 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.343+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50802033b0 con 0x7f50800c4990 2024-04-25T10:39:31.347 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.343+0000 7f507cc00640 1 -- 172.21.15.16:0/2952890138 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5070016800 con 0x7f50800c4990 2024-04-25T10:39:31.348 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 msgr2=0x7f5058071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 0x7f5058071ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f506c007aa0 tx=0x7f506c007a10 comp rx=0 tx=0).stop 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 msgr2=0x7f508015fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f507001d390 tx=0x7f5070019890 comp rx=0 tx=0).stop 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 shutdown_connections 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f505806f5a0 0x7f5058071ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50801f6c90 0x7f50801f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5080205e50 0x7f50800c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 --2- 172.21.15.16:0/2952890138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50800c4990 0x7f508015fd30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 >> 172.21.15.16:0/2952890138 conn(0x7f50800d19d0 msgr2=0x7f50800c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 shutdown_connections 2024-04-25T10:39:31.354 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.347+0000 7f5076000640 1 -- 172.21.15.16:0/2952890138 wait complete. 2024-04-25T10:39:31.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.375+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f62c40059e0 con 0x7f630415b9d0 2024-04-25T10:39:31.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.375+0000 7f62fb400640 1 -- 172.21.15.16:0/2089339997 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f62f405f190 con 0x7f630415b9d0 2024-04-25T10:39:31.380 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 msgr2=0x7f62d8071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 0x7f62d8071a30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f62f00012c0 tx=0x7f62f0009040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 msgr2=0x7f63041f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c560 tx=0x7f62f400ca20 comp rx=0 tx=0).stop 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 shutdown_connections 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f62d806f520 0x7f62d8071a30 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f62f00012c0 tx=0x7f62f0009040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63041648d0 0x7f630415d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f630415b9d0 0x7f63041f1e30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 --2- 172.21.15.16:0/2089339997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f63040c7c40 0x7f630420c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 >> 172.21.15.16:0/2089339997 conn(0x7f63040cdc80 msgr2=0x7f6304159320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 shutdown_connections 2024-04-25T10:39:31.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.379+0000 7f630a200640 1 -- 172.21.15.16:0/2089339997 wait complete. 2024-04-25T10:39:31.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-25T10:39:31.386 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.391+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f80ac0cc7d0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.391+0000 7f80a2000640 1 -- 172.21.15.16:0/977629664 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80980161a0 con 0x7f80ac15a8c0 2024-04-25T10:39:31.396 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 msgr2=0x7f8084071b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 0x7f8084071b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f809c00fbc0 tx=0x7f809c011040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 msgr2=0x7f80ac155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.399 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 0x7f80ac155fd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f80980aa000 tx=0x7f80980192a0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 shutdown_connections 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f808406f620 0x7f8084071b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80ac15d3e0 0x7f80ac15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80ac15a8c0 0x7f80ac155fd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 --2- 172.21.15.16:0/977629664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80ac06d780 0x7f80ac0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 >> 172.21.15.16:0/977629664 conn(0x7f80ac072950 msgr2=0x7f80ac157930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 shutdown_connections 2024-04-25T10:39:31.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7f80b1200640 1 -- 172.21.15.16:0/977629664 wait complete. 2024-04-25T10:39:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.395+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd6e00059e0 con 0x7fd71c0708d0 2024-04-25T10:39:31.403 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.399+0000 7fd718c00640 1 -- 172.21.15.16:0/775899339 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd71c200520 con 0x7fd71c0708d0 2024-04-25T10:39:31.403 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 msgr2=0x7fd6f4071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 0x7fd6f4071ae0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0cc820 tx=0x7fd71400b040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 msgr2=0x7fd71c13f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.406 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd70c0ae040 tx=0x7fd70c01adf0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 shutdown_connections 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fd6f406f5d0 0x7fd6f4071ae0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd71c0c7c40 0x7fd71c0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd71c071bd0 0x7fd71c1fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 --2- 172.21.15.16:0/775899339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd71c0708d0 0x7fd71c13f090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 >> 172.21.15.16:0/775899339 conn(0x7fd71c0ca620 msgr2=0x7fd71c1514b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 shutdown_connections 2024-04-25T10:39:31.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.403+0000 7fd723a00640 1 -- 172.21.15.16:0/775899339 wait complete. 2024-04-25T10:39:31.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.407+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa75c0059e0 con 0x7fa794165540 2024-04-25T10:39:31.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.407+0000 7fa790c00640 1 -- 172.21.15.16:0/1743780684 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa78c010040 con 0x7fa794165540 2024-04-25T10:39:31.412 INFO:teuthology.orchestra.run.smithi016.stdout:55834574860 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 msgr2=0x7fa770071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 0x7fa770071ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa7940cdab0 tx=0x7fa780008040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 msgr2=0x7fa79415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00edb0 tx=0x7fa78c00c490 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 shutdown_connections 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa77006f5a0 0x7fa770071ab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa794165540 0x7fa79415bee0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa79415b8a0 0x7fa7941ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 --2- 172.21.15.16:0/1743780684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa7940cdb20 0x7fa794158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 >> 172.21.15.16:0/1743780684 conn(0x7fa7940d19d0 msgr2=0x7fa794159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 shutdown_connections 2024-04-25T10:39:31.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.411+0000 7fa79bc00640 1 -- 172.21.15.16:0/1743780684 wait complete. 2024-04-25T10:39:31.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-04-25T10:39:31.418 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-25T10:39:31.428 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.431+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffb94005710 con 0x7ffbd00c6080 2024-04-25T10:39:31.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.431+0000 7ffbccc00640 1 -- 172.21.15.16:0/194654951 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffbbc018990 con 0x7ffbd00c6080 2024-04-25T10:39:31.437 INFO:teuthology.orchestra.run.smithi016.stdout:55834574860 2024-04-25T10:39:31.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 msgr2=0x7ffbac071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 0x7ffbac071ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0150850 tx=0x7ffbc4008040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 msgr2=0x7ffbd0148740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01ba40 tx=0x7ffbbc01bbd0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 shutdown_connections 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ffbac06f5d0 0x7ffbac071ae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffbd015b8f0 0x7ffbd0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbd00c82b0 0x7ffbd0148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 --2- 172.21.15.16:0/194654951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd00c6080 0x7ffbd0148740 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 >> 172.21.15.16:0/194654951 conn(0x7ffbd0072950 msgr2=0x7ffbd0153cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 shutdown_connections 2024-04-25T10:39:31.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.435+0000 7ffbd7a00640 1 -- 172.21.15.16:0/194654951 wait complete. 2024-04-25T10:39:31.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2024-04-25T10:39:31.441 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.444 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-25T10:39:31.444 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.454 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fab34005a30 con 0x7fab780c6e50 2024-04-25T10:39:31.455 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6f400640 1 -- 172.21.15.16:0/1923476302 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab640189d0 con 0x7fab780c6e50 2024-04-25T10:39:31.455 INFO:teuthology.orchestra.run.smithi016.stdout:55834574859 2024-04-25T10:39:31.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 msgr2=0x7fab50071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 0x7fab50071ae0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab68007fd0 tx=0x7fab68009040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 msgr2=0x7fab780c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab640b3040 tx=0x7fab6401bc10 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 shutdown_connections 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fab5006f5d0 0x7fab50071ae0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab78165ac0 0x7fab780c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab780c6e50 0x7fab780c4940 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 --2- 172.21.15.16:0/1923476302 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab7806d830 0x7fab781fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 >> 172.21.15.16:0/1923476302 conn(0x7fab78073130 msgr2=0x7fab78159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.451+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 shutdown_connections 2024-04-25T10:39:31.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.455+0000 7fab6cc00640 1 -- 172.21.15.16:0/1923476302 wait complete. 2024-04-25T10:39:31.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-04-25T10:39:31.461 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-25T10:39:31.477 DEBUG:teuthology.parallel:result is None 2024-04-25T10:39:31.478 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:39:31.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:39:31.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.667+0000 7fcae5a00640 1 Processor -- start 2024-04-25T10:39:31.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.667+0000 7fcae5a00640 1 -- start start 2024-04-25T10:39:31.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcae5a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0166d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcae5a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae00c6c50 con 0x7fcae00c82b0 2024-04-25T10:39:31.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcae5a00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcae015bb80 con 0x7fcae01550c0 2024-04-25T10:39:31.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcae5a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcae00c60b0 con 0x7fcae0164900 2024-04-25T10:39:31.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcad6000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcae00c82b0 0x7fcae006cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38546/0 (socket says 172.21.15.16:38546) 2024-04-25T10:39:31.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcad6000640 1 -- 172.21.15.16:0/281497512 learned_addr learned my addr 172.21.15.16:0/281497512 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:31.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcadf400640 1 --2- 172.21.15.16:0/281497512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0166d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24901163 0 0) 0x7fcae00c6c50 con 0x7fcae00c82b0 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcac40035c0 con 0x7fcae00c82b0 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258068473 0 0) 0x7fcae015bb80 con 0x7fcae01550c0 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae00c6c50 con 0x7fcae01550c0 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcadf400640 1 -- 172.21.15.16:0/281497512 >> v1:172.21.15.186:6789/0 conn(0x7fcae01550c0 legacy=0x7fcae00c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcadf400640 1 -- 172.21.15.16:0/281497512 >> v1:172.21.15.16:6789/0 conn(0x7fcae00c82b0 legacy=0x7fcae006cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.671+0000 7fcadf400640 1 -- 172.21.15.16:0/281497512 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae00c5780 con 0x7fcae0164900 2024-04-25T10:39:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcadf400640 1 --2- 172.21.15.16:0/281497512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0166d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae015bd50 tx=0x7fcad801f280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53340b31aec6ecc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad80b4070 con 0x7fcae0164900 2024-04-25T10:39:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad80af600 con 0x7fcae0164900 2024-04-25T10:39:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcade000640 1 -- 172.21.15.16:0/281497512 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad80af9b0 con 0x7fcae0164900 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 -- 172.21.15.16:0/281497512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 msgr2=0x7fcae0166d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 --2- 172.21.15.16:0/281497512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0166d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae015bd50 tx=0x7fcad801f280 comp rx=0 tx=0).stop 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 -- 172.21.15.16:0/281497512 shutdown_connections 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 --2- 172.21.15.16:0/281497512 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0166d20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 -- 172.21.15.16:0/281497512 >> 172.21.15.16:0/281497512 conn(0x7fcae0072950 msgr2=0x7fcae00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 -- 172.21.15.16:0/281497512 shutdown_connections 2024-04-25T10:39:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.675+0000 7fcae5a00640 1 -- 172.21.15.16:0/281497512 wait complete. 2024-04-25T10:39:31.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 Processor -- start 2024-04-25T10:39:31.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- start start 2024-04-25T10:39:31.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcae01550c0 0x7fcae0151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcae00c86c0 con 0x7fcae00c82b0 2024-04-25T10:39:31.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcae00c5d40 con 0x7fcae01550c0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcae015be20 con 0x7fcae0164900 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47034/0 (socket says 172.21.15.16:47034) 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 -- 172.21.15.16:0/1065699305 learned_addr learned my addr 172.21.15.16:0/1065699305 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcad6000640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcae01550c0 0x7fcae0151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadf400640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 -- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 msgr2=0x7fcae0146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 -- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcae01550c0 msgr2=0x7fcae0151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcae01550c0 0x7fcae0151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 -- 172.21.15.16:0/1065699305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae0147400 con 0x7fcae00c82b0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadf400640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcadea00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c4f0 tx=0x7fcad000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad00052d0 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad0005470 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae015c780 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad0012870 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.679+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae01fa4e0 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.683+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae006ea20 con 0x7fcae00c82b0 2024-04-25T10:39:31.687 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.683+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcad0012a50 con 0x7fcae00c82b0 2024-04-25T10:39:31.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.683+0000 7fcad7400640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 0x7fcab8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:31.688 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.683+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcad008f250 con 0x7fcae00c82b0 2024-04-25T10:39:31.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.683+0000 7fcad6000640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 0x7fcab8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:31.689 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.687+0000 7fcad6000640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 0x7fcab8071ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcae014f160 tx=0x7fcac8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:31.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.687+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcad005be40 con 0x7fcae00c82b0 2024-04-25T10:39:31.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.851+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcae0148260 con 0x7fcab806f5d0 2024-04-25T10:39:31.880 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.875+0000 7fcad7400640 1 -- 172.21.15.16:0/1065699305 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332664 (secure 0 0 0) 0x7fcae0148260 con 0x7fcab806f5d0 2024-04-25T10:39:31.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:31.885 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T10:39:31.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 msgr2=0x7fcab8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 0x7fcab8071ae0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcae014f160 tx=0x7fcac8009040 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 msgr2=0x7fcae014f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c4f0 tx=0x7fcad000c9b0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 shutdown_connections 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcab806f5d0 0x7fcab8071ae0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcae0164900 0x7fcae0146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcae01550c0 0x7fcae0151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 --2- 172.21.15.16:0/1065699305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcae00c82b0 0x7fcae014f400 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 >> 172.21.15.16:0/1065699305 conn(0x7fcae0072950 msgr2=0x7fcae00c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 shutdown_connections 2024-04-25T10:39:31.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:31.879+0000 7fcae5a00640 1 -- 172.21.15.16:0/1065699305 wait complete. 2024-04-25T10:39:31.905 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-25T10:39:31.668342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":230,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231072,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743648,"statfs":{"total":773094113280,"available":772857495552,"internally_reserved":0,"allocated":2523136,"data_stored":2092152,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2953,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006755"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812213+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T10:39:24.812213+0000","last_peered":"2024-04-25T10:39:24.812213+0000","last_clean":"2024-04-25T10:39:24.812213+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T10:39:24.812213+0000","last_undegraded":"2024-04-25T10:39:24.812213+0000","last_fullsized":"2024-04-25T10:39:24.812213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376558+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T10:39:05.376558+0000","last_peered":"2024-04-25T10:39:05.376558+0000","last_clean":"2024-04-25T10:39:05.376558+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T10:39:05.376558+0000","last_undegraded":"2024-04-25T10:39:05.376558+0000","last_fullsized":"2024-04-25T10:39:05.376558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375270+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T10:39:05.375270+0000","last_peered":"2024-04-25T10:39:05.375270+0000","last_clean":"2024-04-25T10:39:05.375270+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T10:39:05.375270+0000","last_undegraded":"2024-04-25T10:39:05.375270+0000","last_fullsized":"2024-04-25T10:39:05.375270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376755+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T10:39:05.376755+0000","last_peered":"2024-04-25T10:39:05.376755+0000","last_clean":"2024-04-25T10:39:05.376755+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T10:39:05.376755+0000","last_undegraded":"2024-04-25T10:39:05.376755+0000","last_fullsized":"2024-04-25T10:39:05.376755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371897+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T10:39:06.371897+0000","last_peered":"2024-04-25T10:39:06.371897+0000","last_clean":"2024-04-25T10:39:06.371897+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T10:39:06.371897+0000","last_undegraded":"2024-04-25T10:39:06.371897+0000","last_fullsized":"2024-04-25T10:39:06.371897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407381+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T10:39:06.407381+0000","last_peered":"2024-04-25T10:39:06.407381+0000","last_clean":"2024-04-25T10:39:06.407381+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T10:39:06.407381+0000","last_undegraded":"2024-04-25T10:39:06.407381+0000","last_fullsized":"2024-04-25T10:39:06.407381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812298+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T10:39:24.812298+0000","last_peered":"2024-04-25T10:39:24.812298+0000","last_clean":"2024-04-25T10:39:24.812298+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T10:39:24.812298+0000","last_undegraded":"2024-04-25T10:39:24.812298+0000","last_fullsized":"2024-04-25T10:39:24.812298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382480+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T10:39:05.382480+0000","last_peered":"2024-04-25T10:39:05.382480+0000","last_clean":"2024-04-25T10:39:05.382480+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T10:39:05.382480+0000","last_undegraded":"2024-04-25T10:39:05.382480+0000","last_fullsized":"2024-04-25T10:39:05.382480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408782+0000","last_change":"2024-04-25T10:39:03.421468+0000","last_active":"2024-04-25T10:39:06.408782+0000","last_peered":"2024-04-25T10:39:06.408782+0000","last_clean":"2024-04-25T10:39:06.408782+0000","last_became_active":"2024-04-25T10:39:03.417909+0000","last_became_peered":"2024-04-25T10:39:03.417909+0000","last_unstale":"2024-04-25T10:39:06.408782+0000","last_undegraded":"2024-04-25T10:39:06.408782+0000","last_fullsized":"2024-04-25T10:39:06.408782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:52.327065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261792+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T10:39:06.261792+0000","last_peered":"2024-04-25T10:39:06.261792+0000","last_clean":"2024-04-25T10:39:06.261792+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T10:39:06.261792+0000","last_undegraded":"2024-04-25T10:39:06.261792+0000","last_fullsized":"2024-04-25T10:39:06.261792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380874+0000","last_change":"2024-04-25T10:38:59.354375+0000","last_active":"2024-04-25T10:39:05.380874+0000","last_peered":"2024-04-25T10:39:05.380874+0000","last_clean":"2024-04-25T10:39:05.380874+0000","last_became_active":"2024-04-25T10:38:59.354038+0000","last_became_peered":"2024-04-25T10:38:59.354038+0000","last_unstale":"2024-04-25T10:39:05.380874+0000","last_undegraded":"2024-04-25T10:39:05.380874+0000","last_fullsized":"2024-04-25T10:39:05.380874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408576+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T10:39:06.408576+0000","last_peered":"2024-04-25T10:39:06.408576+0000","last_clean":"2024-04-25T10:39:06.408576+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T10:39:06.408576+0000","last_undegraded":"2024-04-25T10:39:06.408576+0000","last_fullsized":"2024-04-25T10:39:06.408576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382459+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T10:39:05.382459+0000","last_peered":"2024-04-25T10:39:05.382459+0000","last_clean":"2024-04-25T10:39:05.382459+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T10:39:05.382459+0000","last_undegraded":"2024-04-25T10:39:05.382459+0000","last_fullsized":"2024-04-25T10:39:05.382459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.809062+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T10:39:23.809062+0000","last_peered":"2024-04-25T10:39:23.809062+0000","last_clean":"2024-04-25T10:39:23.809062+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T10:39:23.809062+0000","last_undegraded":"2024-04-25T10:39:23.809062+0000","last_fullsized":"2024-04-25T10:39:23.809062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409380+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T10:39:06.409380+0000","last_peered":"2024-04-25T10:39:06.409380+0000","last_clean":"2024-04-25T10:39:06.409380+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T10:39:06.409380+0000","last_undegraded":"2024-04-25T10:39:06.409380+0000","last_fullsized":"2024-04-25T10:39:06.409380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376030+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T10:39:05.376030+0000","last_peered":"2024-04-25T10:39:05.376030+0000","last_clean":"2024-04-25T10:39:05.376030+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T10:39:05.376030+0000","last_undegraded":"2024-04-25T10:39:05.376030+0000","last_fullsized":"2024-04-25T10:39:05.376030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.449980+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T10:39:06.449980+0000","last_peered":"2024-04-25T10:39:06.449980+0000","last_clean":"2024-04-25T10:39:06.449980+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T10:39:06.449980+0000","last_undegraded":"2024-04-25T10:39:06.449980+0000","last_fullsized":"2024-04-25T10:39:06.449980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409320+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T10:39:06.409320+0000","last_peered":"2024-04-25T10:39:06.409320+0000","last_clean":"2024-04-25T10:39:06.409320+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T10:39:06.409320+0000","last_undegraded":"2024-04-25T10:39:06.409320+0000","last_fullsized":"2024-04-25T10:39:06.409320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375570+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T10:39:05.375570+0000","last_peered":"2024-04-25T10:39:05.375570+0000","last_clean":"2024-04-25T10:39:05.375570+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T10:39:05.375570+0000","last_undegraded":"2024-04-25T10:39:05.375570+0000","last_fullsized":"2024-04-25T10:39:05.375570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807891+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T10:39:23.807891+0000","last_peered":"2024-04-25T10:39:23.807891+0000","last_clean":"2024-04-25T10:39:23.807891+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T10:39:23.807891+0000","last_undegraded":"2024-04-25T10:39:23.807891+0000","last_fullsized":"2024-04-25T10:39:23.807891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451376+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T10:39:06.451376+0000","last_peered":"2024-04-25T10:39:06.451376+0000","last_clean":"2024-04-25T10:39:06.451376+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T10:39:06.451376+0000","last_undegraded":"2024-04-25T10:39:06.451376+0000","last_fullsized":"2024-04-25T10:39:06.451376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408308+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T10:39:06.408308+0000","last_peered":"2024-04-25T10:39:06.408308+0000","last_clean":"2024-04-25T10:39:06.408308+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T10:39:06.408308+0000","last_undegraded":"2024-04-25T10:39:06.408308+0000","last_fullsized":"2024-04-25T10:39:06.408308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804664+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T10:39:23.804664+0000","last_peered":"2024-04-25T10:39:23.804664+0000","last_clean":"2024-04-25T10:39:23.804664+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T10:39:23.804664+0000","last_undegraded":"2024-04-25T10:39:23.804664+0000","last_fullsized":"2024-04-25T10:39:23.804664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409798+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T10:39:06.409798+0000","last_peered":"2024-04-25T10:39:06.409798+0000","last_clean":"2024-04-25T10:39:06.409798+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T10:39:06.409798+0000","last_undegraded":"2024-04-25T10:39:06.409798+0000","last_fullsized":"2024-04-25T10:39:06.409798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372078+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T10:39:06.372078+0000","last_peered":"2024-04-25T10:39:06.372078+0000","last_clean":"2024-04-25T10:39:06.372078+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T10:39:06.372078+0000","last_undegraded":"2024-04-25T10:39:06.372078+0000","last_fullsized":"2024-04-25T10:39:06.372078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808734+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T10:39:23.808734+0000","last_peered":"2024-04-25T10:39:23.808734+0000","last_clean":"2024-04-25T10:39:23.808734+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T10:39:23.808734+0000","last_undegraded":"2024-04-25T10:39:23.808734+0000","last_fullsized":"2024-04-25T10:39:23.808734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408232+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T10:39:06.408232+0000","last_peered":"2024-04-25T10:39:06.408232+0000","last_clean":"2024-04-25T10:39:06.408232+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T10:39:06.408232+0000","last_undegraded":"2024-04-25T10:39:06.408232+0000","last_fullsized":"2024-04-25T10:39:06.408232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376780+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T10:39:05.376780+0000","last_peered":"2024-04-25T10:39:05.376780+0000","last_clean":"2024-04-25T10:39:05.376780+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T10:39:05.376780+0000","last_undegraded":"2024-04-25T10:39:05.376780+0000","last_fullsized":"2024-04-25T10:39:05.376780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811522+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T10:39:24.811522+0000","last_peered":"2024-04-25T10:39:24.811522+0000","last_clean":"2024-04-25T10:39:24.811522+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T10:39:24.811522+0000","last_undegraded":"2024-04-25T10:39:24.811522+0000","last_fullsized":"2024-04-25T10:39:24.811522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375180+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T10:39:05.375180+0000","last_peered":"2024-04-25T10:39:05.375180+0000","last_clean":"2024-04-25T10:39:05.375180+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T10:39:05.375180+0000","last_undegraded":"2024-04-25T10:39:05.375180+0000","last_fullsized":"2024-04-25T10:39:05.375180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450786+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T10:39:06.450786+0000","last_peered":"2024-04-25T10:39:06.450786+0000","last_clean":"2024-04-25T10:39:06.450786+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T10:39:06.450786+0000","last_undegraded":"2024-04-25T10:39:06.450786+0000","last_fullsized":"2024-04-25T10:39:06.450786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263127+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T10:39:06.263127+0000","last_peered":"2024-04-25T10:39:06.263127+0000","last_clean":"2024-04-25T10:39:06.263127+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T10:39:06.263127+0000","last_undegraded":"2024-04-25T10:39:06.263127+0000","last_fullsized":"2024-04-25T10:39:06.263127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371458+0000","last_change":"2024-04-25T10:39:04.075522+0000","last_active":"2024-04-25T10:39:06.371458+0000","last_peered":"2024-04-25T10:39:06.371458+0000","last_clean":"2024-04-25T10:39:06.371458+0000","last_became_active":"2024-04-25T10:39:04.074914+0000","last_became_peered":"2024-04-25T10:39:04.074914+0000","last_unstale":"2024-04-25T10:39:06.371458+0000","last_undegraded":"2024-04-25T10:39:06.371458+0000","last_fullsized":"2024-04-25T10:39:06.371458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381205+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T10:39:05.381205+0000","last_peered":"2024-04-25T10:39:05.381205+0000","last_clean":"2024-04-25T10:39:05.381205+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T10:39:05.381205+0000","last_undegraded":"2024-04-25T10:39:05.381205+0000","last_fullsized":"2024-04-25T10:39:05.381205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450880+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T10:39:06.450880+0000","last_peered":"2024-04-25T10:39:06.450880+0000","last_clean":"2024-04-25T10:39:06.450880+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T10:39:06.450880+0000","last_undegraded":"2024-04-25T10:39:06.450880+0000","last_fullsized":"2024-04-25T10:39:06.450880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450432+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T10:39:06.450432+0000","last_peered":"2024-04-25T10:39:06.450432+0000","last_clean":"2024-04-25T10:39:06.450432+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T10:39:06.450432+0000","last_undegraded":"2024-04-25T10:39:06.450432+0000","last_fullsized":"2024-04-25T10:39:06.450432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409748+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T10:39:06.409748+0000","last_peered":"2024-04-25T10:39:06.409748+0000","last_clean":"2024-04-25T10:39:06.409748+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T10:39:06.409748+0000","last_undegraded":"2024-04-25T10:39:06.409748+0000","last_fullsized":"2024-04-25T10:39:06.409748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381353+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T10:39:05.381353+0000","last_peered":"2024-04-25T10:39:05.381353+0000","last_clean":"2024-04-25T10:39:05.381353+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T10:39:05.381353+0000","last_undegraded":"2024-04-25T10:39:05.381353+0000","last_fullsized":"2024-04-25T10:39:05.381353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450864+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T10:39:06.450864+0000","last_peered":"2024-04-25T10:39:06.450864+0000","last_clean":"2024-04-25T10:39:06.450864+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T10:39:06.450864+0000","last_undegraded":"2024-04-25T10:39:06.450864+0000","last_fullsized":"2024-04-25T10:39:06.450864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450419+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T10:39:06.450419+0000","last_peered":"2024-04-25T10:39:06.450419+0000","last_clean":"2024-04-25T10:39:06.450419+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T10:39:06.450419+0000","last_undegraded":"2024-04-25T10:39:06.450419+0000","last_fullsized":"2024-04-25T10:39:06.450419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812672+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T10:39:24.812672+0000","last_peered":"2024-04-25T10:39:24.812672+0000","last_clean":"2024-04-25T10:39:24.812672+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T10:39:24.812672+0000","last_undegraded":"2024-04-25T10:39:24.812672+0000","last_fullsized":"2024-04-25T10:39:24.812672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451427+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T10:39:06.451427+0000","last_peered":"2024-04-25T10:39:06.451427+0000","last_clean":"2024-04-25T10:39:06.451427+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T10:39:06.451427+0000","last_undegraded":"2024-04-25T10:39:06.451427+0000","last_fullsized":"2024-04-25T10:39:06.451427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371193+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T10:39:06.371193+0000","last_peered":"2024-04-25T10:39:06.371193+0000","last_clean":"2024-04-25T10:39:06.371193+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T10:39:06.371193+0000","last_undegraded":"2024-04-25T10:39:06.371193+0000","last_fullsized":"2024-04-25T10:39:06.371193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811354+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T10:39:24.811354+0000","last_peered":"2024-04-25T10:39:24.811354+0000","last_clean":"2024-04-25T10:39:24.811354+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T10:39:24.811354+0000","last_undegraded":"2024-04-25T10:39:24.811354+0000","last_fullsized":"2024-04-25T10:39:24.811354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372014+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T10:39:06.372014+0000","last_peered":"2024-04-25T10:39:06.372014+0000","last_clean":"2024-04-25T10:39:06.372014+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T10:39:06.372014+0000","last_undegraded":"2024-04-25T10:39:06.372014+0000","last_fullsized":"2024-04-25T10:39:06.372014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376170+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T10:39:05.376170+0000","last_peered":"2024-04-25T10:39:05.376170+0000","last_clean":"2024-04-25T10:39:05.376170+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T10:39:05.376170+0000","last_undegraded":"2024-04-25T10:39:05.376170+0000","last_fullsized":"2024-04-25T10:39:05.376170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.806571+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T10:39:23.806571+0000","last_peered":"2024-04-25T10:39:23.806571+0000","last_clean":"2024-04-25T10:39:23.806571+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T10:39:23.806571+0000","last_undegraded":"2024-04-25T10:39:23.806571+0000","last_fullsized":"2024-04-25T10:39:23.806571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261513+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T10:39:06.261513+0000","last_peered":"2024-04-25T10:39:06.261513+0000","last_clean":"2024-04-25T10:39:06.261513+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T10:39:06.261513+0000","last_undegraded":"2024-04-25T10:39:06.261513+0000","last_fullsized":"2024-04-25T10:39:06.261513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383275+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T10:39:05.383275+0000","last_peered":"2024-04-25T10:39:05.383275+0000","last_clean":"2024-04-25T10:39:05.383275+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T10:39:05.383275+0000","last_undegraded":"2024-04-25T10:39:05.383275+0000","last_fullsized":"2024-04-25T10:39:05.383275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261803+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T10:39:06.261803+0000","last_peered":"2024-04-25T10:39:06.261803+0000","last_clean":"2024-04-25T10:39:06.261803+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T10:39:06.261803+0000","last_undegraded":"2024-04-25T10:39:06.261803+0000","last_fullsized":"2024-04-25T10:39:06.261803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812418+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T10:39:24.812418+0000","last_peered":"2024-04-25T10:39:24.812418+0000","last_clean":"2024-04-25T10:39:24.812418+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T10:39:24.812418+0000","last_undegraded":"2024-04-25T10:39:24.812418+0000","last_fullsized":"2024-04-25T10:39:24.812418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379226+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T10:39:05.379226+0000","last_peered":"2024-04-25T10:39:05.379226+0000","last_clean":"2024-04-25T10:39:05.379226+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T10:39:05.379226+0000","last_undegraded":"2024-04-25T10:39:05.379226+0000","last_fullsized":"2024-04-25T10:39:05.379226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382589+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T10:39:05.382589+0000","last_peered":"2024-04-25T10:39:05.382589+0000","last_clean":"2024-04-25T10:39:05.382589+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T10:39:05.382589+0000","last_undegraded":"2024-04-25T10:39:05.382589+0000","last_fullsized":"2024-04-25T10:39:05.382589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450997+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T10:39:06.450997+0000","last_peered":"2024-04-25T10:39:06.450997+0000","last_clean":"2024-04-25T10:39:06.450997+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T10:39:06.450997+0000","last_undegraded":"2024-04-25T10:39:06.450997+0000","last_fullsized":"2024-04-25T10:39:06.450997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371805+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T10:39:06.371805+0000","last_peered":"2024-04-25T10:39:06.371805+0000","last_clean":"2024-04-25T10:39:06.371805+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T10:39:06.371805+0000","last_undegraded":"2024-04-25T10:39:06.371805+0000","last_fullsized":"2024-04-25T10:39:06.371805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263444+0000","last_change":"2024-04-25T10:38:59.376270+0000","last_active":"2024-04-25T10:39:06.263444+0000","last_peered":"2024-04-25T10:39:06.263444+0000","last_clean":"2024-04-25T10:39:06.263444+0000","last_became_active":"2024-04-25T10:38:59.375839+0000","last_became_peered":"2024-04-25T10:38:59.375839+0000","last_unstale":"2024-04-25T10:39:06.263444+0000","last_undegraded":"2024-04-25T10:39:06.263444+0000","last_fullsized":"2024-04-25T10:39:06.263444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:43.103655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407337+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T10:39:06.407337+0000","last_peered":"2024-04-25T10:39:06.407337+0000","last_clean":"2024-04-25T10:39:06.407337+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T10:39:06.407337+0000","last_undegraded":"2024-04-25T10:39:06.407337+0000","last_fullsized":"2024-04-25T10:39:06.407337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378738+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T10:39:05.378738+0000","last_peered":"2024-04-25T10:39:05.378738+0000","last_clean":"2024-04-25T10:39:05.378738+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T10:39:05.378738+0000","last_undegraded":"2024-04-25T10:39:05.378738+0000","last_fullsized":"2024-04-25T10:39:05.378738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262545+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T10:39:06.262545+0000","last_peered":"2024-04-25T10:39:06.262545+0000","last_clean":"2024-04-25T10:39:06.262545+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T10:39:06.262545+0000","last_undegraded":"2024-04-25T10:39:06.262545+0000","last_fullsized":"2024-04-25T10:39:06.262545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.410312+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T10:39:06.410312+0000","last_peered":"2024-04-25T10:39:06.410312+0000","last_clean":"2024-04-25T10:39:06.410312+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T10:39:06.410312+0000","last_undegraded":"2024-04-25T10:39:06.410312+0000","last_fullsized":"2024-04-25T10:39:06.410312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407296+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T10:39:06.407296+0000","last_peered":"2024-04-25T10:39:06.407296+0000","last_clean":"2024-04-25T10:39:06.407296+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T10:39:06.407296+0000","last_undegraded":"2024-04-25T10:39:06.407296+0000","last_fullsized":"2024-04-25T10:39:06.407296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263350+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T10:39:06.263350+0000","last_peered":"2024-04-25T10:39:06.263350+0000","last_clean":"2024-04-25T10:39:06.263350+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T10:39:06.263350+0000","last_undegraded":"2024-04-25T10:39:06.263350+0000","last_fullsized":"2024-04-25T10:39:06.263350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813380+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T10:39:24.813380+0000","last_peered":"2024-04-25T10:39:24.813380+0000","last_clean":"2024-04-25T10:39:24.813380+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T10:39:24.813380+0000","last_undegraded":"2024-04-25T10:39:24.813380+0000","last_fullsized":"2024-04-25T10:39:24.813380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371797+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T10:39:06.371797+0000","last_peered":"2024-04-25T10:39:06.371797+0000","last_clean":"2024-04-25T10:39:06.371797+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T10:39:06.371797+0000","last_undegraded":"2024-04-25T10:39:06.371797+0000","last_fullsized":"2024-04-25T10:39:06.371797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379998+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T10:39:05.379998+0000","last_peered":"2024-04-25T10:39:05.379998+0000","last_clean":"2024-04-25T10:39:05.379998+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T10:39:05.379998+0000","last_undegraded":"2024-04-25T10:39:05.379998+0000","last_fullsized":"2024-04-25T10:39:05.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812430+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T10:39:24.812430+0000","last_peered":"2024-04-25T10:39:24.812430+0000","last_clean":"2024-04-25T10:39:24.812430+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T10:39:24.812430+0000","last_undegraded":"2024-04-25T10:39:24.812430+0000","last_fullsized":"2024-04-25T10:39:24.812430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376592+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T10:39:05.376592+0000","last_peered":"2024-04-25T10:39:05.376592+0000","last_clean":"2024-04-25T10:39:05.376592+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T10:39:05.376592+0000","last_undegraded":"2024-04-25T10:39:05.376592+0000","last_fullsized":"2024-04-25T10:39:05.376592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262028+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T10:39:06.262028+0000","last_peered":"2024-04-25T10:39:06.262028+0000","last_clean":"2024-04-25T10:39:06.262028+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T10:39:06.262028+0000","last_undegraded":"2024-04-25T10:39:06.262028+0000","last_fullsized":"2024-04-25T10:39:06.262028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804398+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T10:39:23.804398+0000","last_peered":"2024-04-25T10:39:23.804398+0000","last_clean":"2024-04-25T10:39:23.804398+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T10:39:23.804398+0000","last_undegraded":"2024-04-25T10:39:23.804398+0000","last_fullsized":"2024-04-25T10:39:23.804398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376022+0000","last_change":"2024-04-25T10:39:04.075730+0000","last_active":"2024-04-25T10:39:05.376022+0000","last_peered":"2024-04-25T10:39:05.376022+0000","last_clean":"2024-04-25T10:39:05.376022+0000","last_became_active":"2024-04-25T10:39:04.074100+0000","last_became_peered":"2024-04-25T10:39:04.074100+0000","last_unstale":"2024-04-25T10:39:05.376022+0000","last_undegraded":"2024-04-25T10:39:05.376022+0000","last_fullsized":"2024-04-25T10:39:05.376022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371541+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T10:39:06.371541+0000","last_peered":"2024-04-25T10:39:06.371541+0000","last_clean":"2024-04-25T10:39:06.371541+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T10:39:06.371541+0000","last_undegraded":"2024-04-25T10:39:06.371541+0000","last_fullsized":"2024-04-25T10:39:06.371541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813673+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T10:39:24.813673+0000","last_peered":"2024-04-25T10:39:24.813673+0000","last_clean":"2024-04-25T10:39:24.813673+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T10:39:24.813673+0000","last_undegraded":"2024-04-25T10:39:24.813673+0000","last_fullsized":"2024-04-25T10:39:24.813673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380495+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T10:39:05.380495+0000","last_peered":"2024-04-25T10:39:05.380495+0000","last_clean":"2024-04-25T10:39:05.380495+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T10:39:05.380495+0000","last_undegraded":"2024-04-25T10:39:05.380495+0000","last_fullsized":"2024-04-25T10:39:05.380495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261538+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T10:39:06.261538+0000","last_peered":"2024-04-25T10:39:06.261538+0000","last_clean":"2024-04-25T10:39:06.261538+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T10:39:06.261538+0000","last_undegraded":"2024-04-25T10:39:06.261538+0000","last_fullsized":"2024-04-25T10:39:06.261538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.801119+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T10:39:23.801119+0000","last_peered":"2024-04-25T10:39:23.801119+0000","last_clean":"2024-04-25T10:39:23.801119+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T10:39:23.801119+0000","last_undegraded":"2024-04-25T10:39:23.801119+0000","last_fullsized":"2024-04-25T10:39:23.801119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450574+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T10:39:06.450574+0000","last_peered":"2024-04-25T10:39:06.450574+0000","last_clean":"2024-04-25T10:39:06.450574+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T10:39:06.450574+0000","last_undegraded":"2024-04-25T10:39:06.450574+0000","last_fullsized":"2024-04-25T10:39:06.450574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409684+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T10:39:06.409684+0000","last_peered":"2024-04-25T10:39:06.409684+0000","last_clean":"2024-04-25T10:39:06.409684+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T10:39:06.409684+0000","last_undegraded":"2024-04-25T10:39:06.409684+0000","last_fullsized":"2024-04-25T10:39:06.409684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450019+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T10:39:06.450019+0000","last_peered":"2024-04-25T10:39:06.450019+0000","last_clean":"2024-04-25T10:39:06.450019+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T10:39:06.450019+0000","last_undegraded":"2024-04-25T10:39:06.450019+0000","last_fullsized":"2024-04-25T10:39:06.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409205+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T10:39:06.409205+0000","last_peered":"2024-04-25T10:39:06.409205+0000","last_clean":"2024-04-25T10:39:06.409205+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T10:39:06.409205+0000","last_undegraded":"2024-04-25T10:39:06.409205+0000","last_fullsized":"2024-04-25T10:39:06.409205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372045+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T10:39:06.372045+0000","last_peered":"2024-04-25T10:39:06.372045+0000","last_clean":"2024-04-25T10:39:06.372045+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T10:39:06.372045+0000","last_undegraded":"2024-04-25T10:39:06.372045+0000","last_fullsized":"2024-04-25T10:39:06.372045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807641+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T10:39:23.807641+0000","last_peered":"2024-04-25T10:39:23.807641+0000","last_clean":"2024-04-25T10:39:23.807641+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T10:39:23.807641+0000","last_undegraded":"2024-04-25T10:39:23.807641+0000","last_fullsized":"2024-04-25T10:39:23.807641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375418+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T10:39:05.375418+0000","last_peered":"2024-04-25T10:39:05.375418+0000","last_clean":"2024-04-25T10:39:05.375418+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T10:39:05.375418+0000","last_undegraded":"2024-04-25T10:39:05.375418+0000","last_fullsized":"2024-04-25T10:39:05.375418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382417+0000","last_change":"2024-04-25T10:38:59.353750+0000","last_active":"2024-04-25T10:39:05.382417+0000","last_peered":"2024-04-25T10:39:05.382417+0000","last_clean":"2024-04-25T10:39:05.382417+0000","last_became_active":"2024-04-25T10:38:59.353056+0000","last_became_peered":"2024-04-25T10:38:59.353056+0000","last_unstale":"2024-04-25T10:39:05.382417+0000","last_undegraded":"2024-04-25T10:39:05.382417+0000","last_fullsized":"2024-04-25T10:39:05.382417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808876+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T10:39:23.808876+0000","last_peered":"2024-04-25T10:39:23.808876+0000","last_clean":"2024-04-25T10:39:23.808876+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T10:39:23.808876+0000","last_undegraded":"2024-04-25T10:39:23.808876+0000","last_fullsized":"2024-04-25T10:39:23.808876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375377+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T10:39:05.375377+0000","last_peered":"2024-04-25T10:39:05.375377+0000","last_clean":"2024-04-25T10:39:05.375377+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T10:39:05.375377+0000","last_undegraded":"2024-04-25T10:39:05.375377+0000","last_fullsized":"2024-04-25T10:39:05.375377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371727+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T10:39:06.371727+0000","last_peered":"2024-04-25T10:39:06.371727+0000","last_clean":"2024-04-25T10:39:06.371727+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T10:39:06.371727+0000","last_undegraded":"2024-04-25T10:39:06.371727+0000","last_fullsized":"2024-04-25T10:39:06.371727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450212+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T10:39:06.450212+0000","last_peered":"2024-04-25T10:39:06.450212+0000","last_clean":"2024-04-25T10:39:06.450212+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T10:39:06.450212+0000","last_undegraded":"2024-04-25T10:39:06.450212+0000","last_fullsized":"2024-04-25T10:39:06.450212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381633+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T10:39:05.381633+0000","last_peered":"2024-04-25T10:39:05.381633+0000","last_clean":"2024-04-25T10:39:05.381633+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T10:39:05.381633+0000","last_undegraded":"2024-04-25T10:39:05.381633+0000","last_fullsized":"2024-04-25T10:39:05.381633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383599+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T10:39:05.383599+0000","last_peered":"2024-04-25T10:39:05.383599+0000","last_clean":"2024-04-25T10:39:05.383599+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T10:39:05.383599+0000","last_undegraded":"2024-04-25T10:39:05.383599+0000","last_fullsized":"2024-04-25T10:39:05.383599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375402+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T10:39:05.375402+0000","last_peered":"2024-04-25T10:39:05.375402+0000","last_clean":"2024-04-25T10:39:05.375402+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T10:39:05.375402+0000","last_undegraded":"2024-04-25T10:39:05.375402+0000","last_fullsized":"2024-04-25T10:39:05.375402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812861+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T10:39:24.812861+0000","last_peered":"2024-04-25T10:39:24.812861+0000","last_clean":"2024-04-25T10:39:24.812861+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T10:39:24.812861+0000","last_undegraded":"2024-04-25T10:39:24.812861+0000","last_fullsized":"2024-04-25T10:39:24.812861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811253+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T10:39:24.811253+0000","last_peered":"2024-04-25T10:39:24.811253+0000","last_clean":"2024-04-25T10:39:24.811253+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T10:39:24.811253+0000","last_undegraded":"2024-04-25T10:39:24.811253+0000","last_fullsized":"2024-04-25T10:39:24.811253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371915+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T10:39:06.371915+0000","last_peered":"2024-04-25T10:39:06.371915+0000","last_clean":"2024-04-25T10:39:06.371915+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T10:39:06.371915+0000","last_undegraded":"2024-04-25T10:39:06.371915+0000","last_fullsized":"2024-04-25T10:39:06.371915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407786+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T10:39:06.407786+0000","last_peered":"2024-04-25T10:39:06.407786+0000","last_clean":"2024-04-25T10:39:06.407786+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T10:39:06.407786+0000","last_undegraded":"2024-04-25T10:39:06.407786+0000","last_fullsized":"2024-04-25T10:39:06.407786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.810784+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T10:39:23.810784+0000","last_peered":"2024-04-25T10:39:23.810784+0000","last_clean":"2024-04-25T10:39:23.810784+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T10:39:23.810784+0000","last_undegraded":"2024-04-25T10:39:23.810784+0000","last_fullsized":"2024-04-25T10:39:23.810784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408790+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T10:39:06.408790+0000","last_peered":"2024-04-25T10:39:06.408790+0000","last_clean":"2024-04-25T10:39:06.408790+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T10:39:06.408790+0000","last_undegraded":"2024-04-25T10:39:06.408790+0000","last_fullsized":"2024-04-25T10:39:06.408790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376153+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T10:39:05.376153+0000","last_peered":"2024-04-25T10:39:05.376153+0000","last_clean":"2024-04-25T10:39:05.376153+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T10:39:05.376153+0000","last_undegraded":"2024-04-25T10:39:05.376153+0000","last_fullsized":"2024-04-25T10:39:05.376153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379483+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T10:39:05.379483+0000","last_peered":"2024-04-25T10:39:05.379483+0000","last_clean":"2024-04-25T10:39:05.379483+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T10:39:05.379483+0000","last_undegraded":"2024-04-25T10:39:05.379483+0000","last_fullsized":"2024-04-25T10:39:05.379483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407574+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T10:39:06.407574+0000","last_peered":"2024-04-25T10:39:06.407574+0000","last_clean":"2024-04-25T10:39:06.407574+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T10:39:06.407574+0000","last_undegraded":"2024-04-25T10:39:06.407574+0000","last_fullsized":"2024-04-25T10:39:06.407574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380900+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T10:39:05.380900+0000","last_peered":"2024-04-25T10:39:05.380900+0000","last_clean":"2024-04-25T10:39:05.380900+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T10:39:05.380900+0000","last_undegraded":"2024-04-25T10:39:05.380900+0000","last_fullsized":"2024-04-25T10:39:05.380900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371754+0000","last_change":"2024-04-25T10:38:59.335488+0000","last_active":"2024-04-25T10:39:06.371754+0000","last_peered":"2024-04-25T10:39:06.371754+0000","last_clean":"2024-04-25T10:39:06.371754+0000","last_became_active":"2024-04-25T10:38:59.335116+0000","last_became_peered":"2024-04-25T10:38:59.335116+0000","last_unstale":"2024-04-25T10:39:06.371754+0000","last_undegraded":"2024-04-25T10:39:06.371754+0000","last_fullsized":"2024-04-25T10:39:06.371754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376240+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T10:39:05.376240+0000","last_peered":"2024-04-25T10:39:05.376240+0000","last_clean":"2024-04-25T10:39:05.376240+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T10:39:05.376240+0000","last_undegraded":"2024-04-25T10:39:05.376240+0000","last_fullsized":"2024-04-25T10:39:05.376240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450833+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T10:39:06.450833+0000","last_peered":"2024-04-25T10:39:06.450833+0000","last_clean":"2024-04-25T10:39:06.450833+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T10:39:06.450833+0000","last_undegraded":"2024-04-25T10:39:06.450833+0000","last_fullsized":"2024-04-25T10:39:06.450833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384578+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T10:39:05.384578+0000","last_peered":"2024-04-25T10:39:05.384578+0000","last_clean":"2024-04-25T10:39:05.384578+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T10:39:05.384578+0000","last_undegraded":"2024-04-25T10:39:05.384578+0000","last_fullsized":"2024-04-25T10:39:05.384578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376701+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T10:39:05.376701+0000","last_peered":"2024-04-25T10:39:05.376701+0000","last_clean":"2024-04-25T10:39:05.376701+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T10:39:05.376701+0000","last_undegraded":"2024-04-25T10:39:05.376701+0000","last_fullsized":"2024-04-25T10:39:05.376701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379166+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T10:39:05.379166+0000","last_peered":"2024-04-25T10:39:05.379166+0000","last_clean":"2024-04-25T10:39:05.379166+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T10:39:05.379166+0000","last_undegraded":"2024-04-25T10:39:05.379166+0000","last_fullsized":"2024-04-25T10:39:05.379166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375532+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T10:39:05.375532+0000","last_peered":"2024-04-25T10:39:05.375532+0000","last_clean":"2024-04-25T10:39:05.375532+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T10:39:05.375532+0000","last_undegraded":"2024-04-25T10:39:05.375532+0000","last_fullsized":"2024-04-25T10:39:05.375532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380616+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T10:39:05.380616+0000","last_peered":"2024-04-25T10:39:05.380616+0000","last_clean":"2024-04-25T10:39:05.380616+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T10:39:05.380616+0000","last_undegraded":"2024-04-25T10:39:05.380616+0000","last_fullsized":"2024-04-25T10:39:05.380616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371579+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T10:39:06.371579+0000","last_peered":"2024-04-25T10:39:06.371579+0000","last_clean":"2024-04-25T10:39:06.371579+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T10:39:06.371579+0000","last_undegraded":"2024-04-25T10:39:06.371579+0000","last_fullsized":"2024-04-25T10:39:06.371579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384073+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T10:39:05.384073+0000","last_peered":"2024-04-25T10:39:05.384073+0000","last_clean":"2024-04-25T10:39:05.384073+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T10:39:05.384073+0000","last_undegraded":"2024-04-25T10:39:05.384073+0000","last_fullsized":"2024-04-25T10:39:05.384073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262884+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T10:39:06.262884+0000","last_peered":"2024-04-25T10:39:06.262884+0000","last_clean":"2024-04-25T10:39:06.262884+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T10:39:06.262884+0000","last_undegraded":"2024-04-25T10:39:06.262884+0000","last_fullsized":"2024-04-25T10:39:06.262884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407870+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T10:39:06.407870+0000","last_peered":"2024-04-25T10:39:06.407870+0000","last_clean":"2024-04-25T10:39:06.407870+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T10:39:06.407870+0000","last_undegraded":"2024-04-25T10:39:06.407870+0000","last_fullsized":"2024-04-25T10:39:06.407870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382695+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T10:39:05.382695+0000","last_peered":"2024-04-25T10:39:05.382695+0000","last_clean":"2024-04-25T10:39:05.382695+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T10:39:05.382695+0000","last_undegraded":"2024-04-25T10:39:05.382695+0000","last_fullsized":"2024-04-25T10:39:05.382695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378766+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T10:39:05.378766+0000","last_peered":"2024-04-25T10:39:05.378766+0000","last_clean":"2024-04-25T10:39:05.378766+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T10:39:05.378766+0000","last_undegraded":"2024-04-25T10:39:05.378766+0000","last_fullsized":"2024-04-25T10:39:05.378766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450284+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T10:39:06.450284+0000","last_peered":"2024-04-25T10:39:06.450284+0000","last_clean":"2024-04-25T10:39:06.450284+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T10:39:06.450284+0000","last_undegraded":"2024-04-25T10:39:06.450284+0000","last_fullsized":"2024-04-25T10:39:06.450284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371478+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T10:39:06.371478+0000","last_peered":"2024-04-25T10:39:06.371478+0000","last_clean":"2024-04-25T10:39:06.371478+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T10:39:06.371478+0000","last_undegraded":"2024-04-25T10:39:06.371478+0000","last_fullsized":"2024-04-25T10:39:06.371478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376036+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T10:39:05.376036+0000","last_peered":"2024-04-25T10:39:05.376036+0000","last_clean":"2024-04-25T10:39:05.376036+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T10:39:05.376036+0000","last_undegraded":"2024-04-25T10:39:05.376036+0000","last_fullsized":"2024-04-25T10:39:05.376036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409436+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T10:39:06.409436+0000","last_peered":"2024-04-25T10:39:06.409436+0000","last_clean":"2024-04-25T10:39:06.409436+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T10:39:06.409436+0000","last_undegraded":"2024-04-25T10:39:06.409436+0000","last_fullsized":"2024-04-25T10:39:06.409436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383406+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T10:39:05.383406+0000","last_peered":"2024-04-25T10:39:05.383406+0000","last_clean":"2024-04-25T10:39:05.383406+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T10:39:05.383406+0000","last_undegraded":"2024-04-25T10:39:05.383406+0000","last_fullsized":"2024-04-25T10:39:05.383406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384611+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T10:39:05.384611+0000","last_peered":"2024-04-25T10:39:05.384611+0000","last_clean":"2024-04-25T10:39:05.384611+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T10:39:05.384611+0000","last_undegraded":"2024-04-25T10:39:05.384611+0000","last_fullsized":"2024-04-25T10:39:05.384611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263214+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T10:39:06.263214+0000","last_peered":"2024-04-25T10:39:06.263214+0000","last_clean":"2024-04-25T10:39:06.263214+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T10:39:06.263214+0000","last_undegraded":"2024-04-25T10:39:06.263214+0000","last_fullsized":"2024-04-25T10:39:06.263214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375273+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T10:39:05.375273+0000","last_peered":"2024-04-25T10:39:05.375273+0000","last_clean":"2024-04-25T10:39:05.375273+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T10:39:05.375273+0000","last_undegraded":"2024-04-25T10:39:05.375273+0000","last_fullsized":"2024-04-25T10:39:05.375273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262803+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T10:39:06.262803+0000","last_peered":"2024-04-25T10:39:06.262803+0000","last_clean":"2024-04-25T10:39:06.262803+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T10:39:06.262803+0000","last_undegraded":"2024-04-25T10:39:06.262803+0000","last_fullsized":"2024-04-25T10:39:06.262803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380508+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T10:39:05.380508+0000","last_peered":"2024-04-25T10:39:05.380508+0000","last_clean":"2024-04-25T10:39:05.380508+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T10:39:05.380508+0000","last_undegraded":"2024-04-25T10:39:05.380508+0000","last_fullsized":"2024-04-25T10:39:05.380508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261606+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T10:39:06.261606+0000","last_peered":"2024-04-25T10:39:06.261606+0000","last_clean":"2024-04-25T10:39:06.261606+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T10:39:06.261606+0000","last_undegraded":"2024-04-25T10:39:06.261606+0000","last_fullsized":"2024-04-25T10:39:06.261606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382113+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T10:39:05.382113+0000","last_peered":"2024-04-25T10:39:05.382113+0000","last_clean":"2024-04-25T10:39:05.382113+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T10:39:05.382113+0000","last_undegraded":"2024-04-25T10:39:05.382113+0000","last_fullsized":"2024-04-25T10:39:05.382113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371520+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T10:39:06.371520+0000","last_peered":"2024-04-25T10:39:06.371520+0000","last_clean":"2024-04-25T10:39:06.371520+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T10:39:06.371520+0000","last_undegraded":"2024-04-25T10:39:06.371520+0000","last_fullsized":"2024-04-25T10:39:06.371520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451173+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T10:39:06.451173+0000","last_peered":"2024-04-25T10:39:06.451173+0000","last_clean":"2024-04-25T10:39:06.451173+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T10:39:06.451173+0000","last_undegraded":"2024-04-25T10:39:06.451173+0000","last_fullsized":"2024-04-25T10:39:06.451173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262865+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T10:39:06.262865+0000","last_peered":"2024-04-25T10:39:06.262865+0000","last_clean":"2024-04-25T10:39:06.262865+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T10:39:06.262865+0000","last_undegraded":"2024-04-25T10:39:06.262865+0000","last_fullsized":"2024-04-25T10:39:06.262865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":703748,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":116584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":113442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":116618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":112882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":113008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":703092,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:39:31.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:39:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.091+0000 7f472a000640 1 Processor -- start 2024-04-25T10:39:32.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.091+0000 7f472a000640 1 -- start start 2024-04-25T10:39:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f472a000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f472a000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f472a000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47240cbc40 con 0x7f47240cc4d0 2024-04-25T10:39:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f472a000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f472415f4a0 con 0x7f47240cc0c0 2024-04-25T10:39:32.099 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f472a000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f472415e5b0 con 0x7f472415b310 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:33648/0 (socket says 172.21.15.16:33648) 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723400640 1 -- 172.21.15.16:0/2920041156 learned_addr learned my addr 172.21.15.16:0/2920041156 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46794/0 (socket says 172.21.15.16:46794) 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f471be00640 1 --1- 172.21.15.16:0/2920041156 >> v1:172.21.15.186:6789/0 conn(0x7f47240cc4d0 0x7f4724154e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:45418/0 (socket says 172.21.15.16:45418) 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 -- 172.21.15.16:0/2920041156 >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 msgr2=0x7f47240c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 --2- 172.21.15.16:0/2920041156 >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 -- 172.21.15.16:0/2920041156 >> v1:172.21.15.186:6789/0 conn(0x7f47240cc4d0 legacy=0x7f4724154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723e00640 1 -- 172.21.15.16:0/2920041156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472415e890 con 0x7f472415b310 2024-04-25T10:39:32.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.095+0000 7f4723400640 1 --2- 172.21.15.16:0/2920041156 >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:32.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f4723e00640 1 --2- 172.21.15.16:0/2920041156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f472415f620 tx=0x7f471c01f240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a4a2f6ad0094c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f4722a00640 1 -- 172.21.15.16:0/2920041156 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c0b4070 con 0x7f472415b310 2024-04-25T10:39:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f4722a00640 1 -- 172.21.15.16:0/2920041156 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c0af600 con 0x7f472415b310 2024-04-25T10:39:32.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f4722a00640 1 -- 172.21.15.16:0/2920041156 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c0afa10 con 0x7f472415b310 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 -- 172.21.15.16:0/2920041156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 msgr2=0x7f472415b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 --2- 172.21.15.16:0/2920041156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f472415f620 tx=0x7f471c01f240 comp rx=0 tx=0).stop 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 -- 172.21.15.16:0/2920041156 shutdown_connections 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 --2- 172.21.15.16:0/2920041156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472415b720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 --2- 172.21.15.16:0/2920041156 >> v2:172.21.15.186:3300/0 conn(0x7f47240cc0c0 0x7f47240c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 -- 172.21.15.16:0/2920041156 >> 172.21.15.16:0/2920041156 conn(0x7f47240730f0 msgr2=0x7f47240735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 -- 172.21.15.16:0/2920041156 shutdown_connections 2024-04-25T10:39:32.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.099+0000 7f472a000640 1 -- 172.21.15.16:0/2920041156 wait complete. 2024-04-25T10:39:32.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 Processor -- start 2024-04-25T10:39:32.107 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 -- start start 2024-04-25T10:39:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47240cc0c0 0x7f47240afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f472415f130 con 0x7f47240cc4d0 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f472415ee50 con 0x7f47240cc0c0 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f472a000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f472415bc60 con 0x7f472415b310 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47038/0 (socket says 172.21.15.16:47038) 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 -- 172.21.15.16:0/3081367202 learned_addr learned my addr 172.21.15.16:0/3081367202 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f4723e00640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f4723400640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47240cc0c0 0x7f47240afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 -- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 msgr2=0x7f472406ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472406ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 -- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47240cc0c0 msgr2=0x7f47240afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47240cc0c0 0x7f47240afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.103+0000 7f471be00640 1 -- 172.21.15.16:0/3081367202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47241fc690 con 0x7f47240cc4d0 2024-04-25T10:39:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471be00640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c4e0 tx=0x7f470c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c018070 con 0x7f47240cc4d0 2024-04-25T10:39:32.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f470c007480 con 0x7f47240cc4d0 2024-04-25T10:39:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470c0047f0 con 0x7f47240cc4d0 2024-04-25T10:39:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241559d0 con 0x7f47240cc4d0 2024-04-25T10:39:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4724155f50 con 0x7f47240cc4d0 2024-04-25T10:39:32.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47241f92f0 con 0x7f47240cc4d0 2024-04-25T10:39:32.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f470c004a10 con 0x7f47240cc4d0 2024-04-25T10:39:32.113 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.107+0000 7f471b400640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 0x7f46fc071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.111+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f470c08e6b0 con 0x7f47240cc4d0 2024-04-25T10:39:32.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.111+0000 7f4723400640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 0x7f46fc071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.111+0000 7f4723400640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 0x7f46fc071ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4714009680 tx=0x7f4714009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.115+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f470c05ac50 con 0x7f47240cc4d0 2024-04-25T10:39:32.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.275+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47241fc8a0 con 0x7f46fc06f5a0 2024-04-25T10:39:32.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.299+0000 7f471b400640 1 -- 172.21.15.16:0/3081367202 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332664 (secure 0 0 0) 0x7f47241fc8a0 con 0x7f46fc06f5a0 2024-04-25T10:39:32.306 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:32.308 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 msgr2=0x7f46fc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 0x7f46fc071ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4714009680 tx=0x7f4714009290 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 msgr2=0x7f47241fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f470c00c4e0 tx=0x7f470c00c9a0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 shutdown_connections 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f46fc06f5a0 0x7f46fc071ab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f472415b310 0x7f472406ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47240cc4d0 0x7f47241fc150 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 --2- 172.21.15.16:0/3081367202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47240cc0c0 0x7f47240afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 >> 172.21.15.16:0/3081367202 conn(0x7f47240730f0 msgr2=0x7f4724152760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 shutdown_connections 2024-04-25T10:39:32.310 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.303+0000 7f472a000640 1 -- 172.21.15.16:0/3081367202 wait complete. 2024-04-25T10:39:32.328 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-04-25T10:39:31.668342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":230,"num_write_kb":1671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231072,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743648,"statfs":{"total":773094113280,"available":772857495552,"internally_reserved":0,"allocated":2523136,"data_stored":2092152,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2953,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006755"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812213+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T10:39:24.812213+0000","last_peered":"2024-04-25T10:39:24.812213+0000","last_clean":"2024-04-25T10:39:24.812213+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T10:39:24.812213+0000","last_undegraded":"2024-04-25T10:39:24.812213+0000","last_fullsized":"2024-04-25T10:39:24.812213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376558+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T10:39:05.376558+0000","last_peered":"2024-04-25T10:39:05.376558+0000","last_clean":"2024-04-25T10:39:05.376558+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T10:39:05.376558+0000","last_undegraded":"2024-04-25T10:39:05.376558+0000","last_fullsized":"2024-04-25T10:39:05.376558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375270+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T10:39:05.375270+0000","last_peered":"2024-04-25T10:39:05.375270+0000","last_clean":"2024-04-25T10:39:05.375270+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T10:39:05.375270+0000","last_undegraded":"2024-04-25T10:39:05.375270+0000","last_fullsized":"2024-04-25T10:39:05.375270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376755+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T10:39:05.376755+0000","last_peered":"2024-04-25T10:39:05.376755+0000","last_clean":"2024-04-25T10:39:05.376755+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T10:39:05.376755+0000","last_undegraded":"2024-04-25T10:39:05.376755+0000","last_fullsized":"2024-04-25T10:39:05.376755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371897+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T10:39:06.371897+0000","last_peered":"2024-04-25T10:39:06.371897+0000","last_clean":"2024-04-25T10:39:06.371897+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T10:39:06.371897+0000","last_undegraded":"2024-04-25T10:39:06.371897+0000","last_fullsized":"2024-04-25T10:39:06.371897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407381+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T10:39:06.407381+0000","last_peered":"2024-04-25T10:39:06.407381+0000","last_clean":"2024-04-25T10:39:06.407381+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T10:39:06.407381+0000","last_undegraded":"2024-04-25T10:39:06.407381+0000","last_fullsized":"2024-04-25T10:39:06.407381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812298+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T10:39:24.812298+0000","last_peered":"2024-04-25T10:39:24.812298+0000","last_clean":"2024-04-25T10:39:24.812298+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T10:39:24.812298+0000","last_undegraded":"2024-04-25T10:39:24.812298+0000","last_fullsized":"2024-04-25T10:39:24.812298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382480+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T10:39:05.382480+0000","last_peered":"2024-04-25T10:39:05.382480+0000","last_clean":"2024-04-25T10:39:05.382480+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T10:39:05.382480+0000","last_undegraded":"2024-04-25T10:39:05.382480+0000","last_fullsized":"2024-04-25T10:39:05.382480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408782+0000","last_change":"2024-04-25T10:39:03.421468+0000","last_active":"2024-04-25T10:39:06.408782+0000","last_peered":"2024-04-25T10:39:06.408782+0000","last_clean":"2024-04-25T10:39:06.408782+0000","last_became_active":"2024-04-25T10:39:03.417909+0000","last_became_peered":"2024-04-25T10:39:03.417909+0000","last_unstale":"2024-04-25T10:39:06.408782+0000","last_undegraded":"2024-04-25T10:39:06.408782+0000","last_fullsized":"2024-04-25T10:39:06.408782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:52.327065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261792+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T10:39:06.261792+0000","last_peered":"2024-04-25T10:39:06.261792+0000","last_clean":"2024-04-25T10:39:06.261792+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T10:39:06.261792+0000","last_undegraded":"2024-04-25T10:39:06.261792+0000","last_fullsized":"2024-04-25T10:39:06.261792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380874+0000","last_change":"2024-04-25T10:38:59.354375+0000","last_active":"2024-04-25T10:39:05.380874+0000","last_peered":"2024-04-25T10:39:05.380874+0000","last_clean":"2024-04-25T10:39:05.380874+0000","last_became_active":"2024-04-25T10:38:59.354038+0000","last_became_peered":"2024-04-25T10:38:59.354038+0000","last_unstale":"2024-04-25T10:39:05.380874+0000","last_undegraded":"2024-04-25T10:39:05.380874+0000","last_fullsized":"2024-04-25T10:39:05.380874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408576+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T10:39:06.408576+0000","last_peered":"2024-04-25T10:39:06.408576+0000","last_clean":"2024-04-25T10:39:06.408576+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T10:39:06.408576+0000","last_undegraded":"2024-04-25T10:39:06.408576+0000","last_fullsized":"2024-04-25T10:39:06.408576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382459+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T10:39:05.382459+0000","last_peered":"2024-04-25T10:39:05.382459+0000","last_clean":"2024-04-25T10:39:05.382459+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T10:39:05.382459+0000","last_undegraded":"2024-04-25T10:39:05.382459+0000","last_fullsized":"2024-04-25T10:39:05.382459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.809062+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T10:39:23.809062+0000","last_peered":"2024-04-25T10:39:23.809062+0000","last_clean":"2024-04-25T10:39:23.809062+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T10:39:23.809062+0000","last_undegraded":"2024-04-25T10:39:23.809062+0000","last_fullsized":"2024-04-25T10:39:23.809062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409380+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T10:39:06.409380+0000","last_peered":"2024-04-25T10:39:06.409380+0000","last_clean":"2024-04-25T10:39:06.409380+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T10:39:06.409380+0000","last_undegraded":"2024-04-25T10:39:06.409380+0000","last_fullsized":"2024-04-25T10:39:06.409380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376030+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T10:39:05.376030+0000","last_peered":"2024-04-25T10:39:05.376030+0000","last_clean":"2024-04-25T10:39:05.376030+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T10:39:05.376030+0000","last_undegraded":"2024-04-25T10:39:05.376030+0000","last_fullsized":"2024-04-25T10:39:05.376030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.449980+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T10:39:06.449980+0000","last_peered":"2024-04-25T10:39:06.449980+0000","last_clean":"2024-04-25T10:39:06.449980+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T10:39:06.449980+0000","last_undegraded":"2024-04-25T10:39:06.449980+0000","last_fullsized":"2024-04-25T10:39:06.449980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409320+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T10:39:06.409320+0000","last_peered":"2024-04-25T10:39:06.409320+0000","last_clean":"2024-04-25T10:39:06.409320+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T10:39:06.409320+0000","last_undegraded":"2024-04-25T10:39:06.409320+0000","last_fullsized":"2024-04-25T10:39:06.409320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375570+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T10:39:05.375570+0000","last_peered":"2024-04-25T10:39:05.375570+0000","last_clean":"2024-04-25T10:39:05.375570+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T10:39:05.375570+0000","last_undegraded":"2024-04-25T10:39:05.375570+0000","last_fullsized":"2024-04-25T10:39:05.375570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807891+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T10:39:23.807891+0000","last_peered":"2024-04-25T10:39:23.807891+0000","last_clean":"2024-04-25T10:39:23.807891+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T10:39:23.807891+0000","last_undegraded":"2024-04-25T10:39:23.807891+0000","last_fullsized":"2024-04-25T10:39:23.807891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451376+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T10:39:06.451376+0000","last_peered":"2024-04-25T10:39:06.451376+0000","last_clean":"2024-04-25T10:39:06.451376+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T10:39:06.451376+0000","last_undegraded":"2024-04-25T10:39:06.451376+0000","last_fullsized":"2024-04-25T10:39:06.451376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408308+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T10:39:06.408308+0000","last_peered":"2024-04-25T10:39:06.408308+0000","last_clean":"2024-04-25T10:39:06.408308+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T10:39:06.408308+0000","last_undegraded":"2024-04-25T10:39:06.408308+0000","last_fullsized":"2024-04-25T10:39:06.408308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804664+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T10:39:23.804664+0000","last_peered":"2024-04-25T10:39:23.804664+0000","last_clean":"2024-04-25T10:39:23.804664+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T10:39:23.804664+0000","last_undegraded":"2024-04-25T10:39:23.804664+0000","last_fullsized":"2024-04-25T10:39:23.804664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409798+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T10:39:06.409798+0000","last_peered":"2024-04-25T10:39:06.409798+0000","last_clean":"2024-04-25T10:39:06.409798+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T10:39:06.409798+0000","last_undegraded":"2024-04-25T10:39:06.409798+0000","last_fullsized":"2024-04-25T10:39:06.409798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372078+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T10:39:06.372078+0000","last_peered":"2024-04-25T10:39:06.372078+0000","last_clean":"2024-04-25T10:39:06.372078+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T10:39:06.372078+0000","last_undegraded":"2024-04-25T10:39:06.372078+0000","last_fullsized":"2024-04-25T10:39:06.372078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808734+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T10:39:23.808734+0000","last_peered":"2024-04-25T10:39:23.808734+0000","last_clean":"2024-04-25T10:39:23.808734+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T10:39:23.808734+0000","last_undegraded":"2024-04-25T10:39:23.808734+0000","last_fullsized":"2024-04-25T10:39:23.808734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408232+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T10:39:06.408232+0000","last_peered":"2024-04-25T10:39:06.408232+0000","last_clean":"2024-04-25T10:39:06.408232+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T10:39:06.408232+0000","last_undegraded":"2024-04-25T10:39:06.408232+0000","last_fullsized":"2024-04-25T10:39:06.408232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376780+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T10:39:05.376780+0000","last_peered":"2024-04-25T10:39:05.376780+0000","last_clean":"2024-04-25T10:39:05.376780+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T10:39:05.376780+0000","last_undegraded":"2024-04-25T10:39:05.376780+0000","last_fullsized":"2024-04-25T10:39:05.376780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811522+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T10:39:24.811522+0000","last_peered":"2024-04-25T10:39:24.811522+0000","last_clean":"2024-04-25T10:39:24.811522+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T10:39:24.811522+0000","last_undegraded":"2024-04-25T10:39:24.811522+0000","last_fullsized":"2024-04-25T10:39:24.811522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375180+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T10:39:05.375180+0000","last_peered":"2024-04-25T10:39:05.375180+0000","last_clean":"2024-04-25T10:39:05.375180+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T10:39:05.375180+0000","last_undegraded":"2024-04-25T10:39:05.375180+0000","last_fullsized":"2024-04-25T10:39:05.375180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450786+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T10:39:06.450786+0000","last_peered":"2024-04-25T10:39:06.450786+0000","last_clean":"2024-04-25T10:39:06.450786+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T10:39:06.450786+0000","last_undegraded":"2024-04-25T10:39:06.450786+0000","last_fullsized":"2024-04-25T10:39:06.450786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263127+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T10:39:06.263127+0000","last_peered":"2024-04-25T10:39:06.263127+0000","last_clean":"2024-04-25T10:39:06.263127+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T10:39:06.263127+0000","last_undegraded":"2024-04-25T10:39:06.263127+0000","last_fullsized":"2024-04-25T10:39:06.263127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371458+0000","last_change":"2024-04-25T10:39:04.075522+0000","last_active":"2024-04-25T10:39:06.371458+0000","last_peered":"2024-04-25T10:39:06.371458+0000","last_clean":"2024-04-25T10:39:06.371458+0000","last_became_active":"2024-04-25T10:39:04.074914+0000","last_became_peered":"2024-04-25T10:39:04.074914+0000","last_unstale":"2024-04-25T10:39:06.371458+0000","last_undegraded":"2024-04-25T10:39:06.371458+0000","last_fullsized":"2024-04-25T10:39:06.371458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381205+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T10:39:05.381205+0000","last_peered":"2024-04-25T10:39:05.381205+0000","last_clean":"2024-04-25T10:39:05.381205+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T10:39:05.381205+0000","last_undegraded":"2024-04-25T10:39:05.381205+0000","last_fullsized":"2024-04-25T10:39:05.381205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450880+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T10:39:06.450880+0000","last_peered":"2024-04-25T10:39:06.450880+0000","last_clean":"2024-04-25T10:39:06.450880+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T10:39:06.450880+0000","last_undegraded":"2024-04-25T10:39:06.450880+0000","last_fullsized":"2024-04-25T10:39:06.450880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450432+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T10:39:06.450432+0000","last_peered":"2024-04-25T10:39:06.450432+0000","last_clean":"2024-04-25T10:39:06.450432+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T10:39:06.450432+0000","last_undegraded":"2024-04-25T10:39:06.450432+0000","last_fullsized":"2024-04-25T10:39:06.450432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409748+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T10:39:06.409748+0000","last_peered":"2024-04-25T10:39:06.409748+0000","last_clean":"2024-04-25T10:39:06.409748+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T10:39:06.409748+0000","last_undegraded":"2024-04-25T10:39:06.409748+0000","last_fullsized":"2024-04-25T10:39:06.409748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381353+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T10:39:05.381353+0000","last_peered":"2024-04-25T10:39:05.381353+0000","last_clean":"2024-04-25T10:39:05.381353+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T10:39:05.381353+0000","last_undegraded":"2024-04-25T10:39:05.381353+0000","last_fullsized":"2024-04-25T10:39:05.381353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450864+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T10:39:06.450864+0000","last_peered":"2024-04-25T10:39:06.450864+0000","last_clean":"2024-04-25T10:39:06.450864+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T10:39:06.450864+0000","last_undegraded":"2024-04-25T10:39:06.450864+0000","last_fullsized":"2024-04-25T10:39:06.450864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450419+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T10:39:06.450419+0000","last_peered":"2024-04-25T10:39:06.450419+0000","last_clean":"2024-04-25T10:39:06.450419+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T10:39:06.450419+0000","last_undegraded":"2024-04-25T10:39:06.450419+0000","last_fullsized":"2024-04-25T10:39:06.450419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812672+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T10:39:24.812672+0000","last_peered":"2024-04-25T10:39:24.812672+0000","last_clean":"2024-04-25T10:39:24.812672+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T10:39:24.812672+0000","last_undegraded":"2024-04-25T10:39:24.812672+0000","last_fullsized":"2024-04-25T10:39:24.812672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451427+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T10:39:06.451427+0000","last_peered":"2024-04-25T10:39:06.451427+0000","last_clean":"2024-04-25T10:39:06.451427+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T10:39:06.451427+0000","last_undegraded":"2024-04-25T10:39:06.451427+0000","last_fullsized":"2024-04-25T10:39:06.451427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371193+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T10:39:06.371193+0000","last_peered":"2024-04-25T10:39:06.371193+0000","last_clean":"2024-04-25T10:39:06.371193+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T10:39:06.371193+0000","last_undegraded":"2024-04-25T10:39:06.371193+0000","last_fullsized":"2024-04-25T10:39:06.371193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811354+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T10:39:24.811354+0000","last_peered":"2024-04-25T10:39:24.811354+0000","last_clean":"2024-04-25T10:39:24.811354+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T10:39:24.811354+0000","last_undegraded":"2024-04-25T10:39:24.811354+0000","last_fullsized":"2024-04-25T10:39:24.811354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372014+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T10:39:06.372014+0000","last_peered":"2024-04-25T10:39:06.372014+0000","last_clean":"2024-04-25T10:39:06.372014+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T10:39:06.372014+0000","last_undegraded":"2024-04-25T10:39:06.372014+0000","last_fullsized":"2024-04-25T10:39:06.372014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376170+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T10:39:05.376170+0000","last_peered":"2024-04-25T10:39:05.376170+0000","last_clean":"2024-04-25T10:39:05.376170+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T10:39:05.376170+0000","last_undegraded":"2024-04-25T10:39:05.376170+0000","last_fullsized":"2024-04-25T10:39:05.376170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.806571+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T10:39:23.806571+0000","last_peered":"2024-04-25T10:39:23.806571+0000","last_clean":"2024-04-25T10:39:23.806571+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T10:39:23.806571+0000","last_undegraded":"2024-04-25T10:39:23.806571+0000","last_fullsized":"2024-04-25T10:39:23.806571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261513+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T10:39:06.261513+0000","last_peered":"2024-04-25T10:39:06.261513+0000","last_clean":"2024-04-25T10:39:06.261513+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T10:39:06.261513+0000","last_undegraded":"2024-04-25T10:39:06.261513+0000","last_fullsized":"2024-04-25T10:39:06.261513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383275+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T10:39:05.383275+0000","last_peered":"2024-04-25T10:39:05.383275+0000","last_clean":"2024-04-25T10:39:05.383275+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T10:39:05.383275+0000","last_undegraded":"2024-04-25T10:39:05.383275+0000","last_fullsized":"2024-04-25T10:39:05.383275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261803+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T10:39:06.261803+0000","last_peered":"2024-04-25T10:39:06.261803+0000","last_clean":"2024-04-25T10:39:06.261803+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T10:39:06.261803+0000","last_undegraded":"2024-04-25T10:39:06.261803+0000","last_fullsized":"2024-04-25T10:39:06.261803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812418+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T10:39:24.812418+0000","last_peered":"2024-04-25T10:39:24.812418+0000","last_clean":"2024-04-25T10:39:24.812418+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T10:39:24.812418+0000","last_undegraded":"2024-04-25T10:39:24.812418+0000","last_fullsized":"2024-04-25T10:39:24.812418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379226+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T10:39:05.379226+0000","last_peered":"2024-04-25T10:39:05.379226+0000","last_clean":"2024-04-25T10:39:05.379226+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T10:39:05.379226+0000","last_undegraded":"2024-04-25T10:39:05.379226+0000","last_fullsized":"2024-04-25T10:39:05.379226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382589+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T10:39:05.382589+0000","last_peered":"2024-04-25T10:39:05.382589+0000","last_clean":"2024-04-25T10:39:05.382589+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T10:39:05.382589+0000","last_undegraded":"2024-04-25T10:39:05.382589+0000","last_fullsized":"2024-04-25T10:39:05.382589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450997+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T10:39:06.450997+0000","last_peered":"2024-04-25T10:39:06.450997+0000","last_clean":"2024-04-25T10:39:06.450997+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T10:39:06.450997+0000","last_undegraded":"2024-04-25T10:39:06.450997+0000","last_fullsized":"2024-04-25T10:39:06.450997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371805+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T10:39:06.371805+0000","last_peered":"2024-04-25T10:39:06.371805+0000","last_clean":"2024-04-25T10:39:06.371805+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T10:39:06.371805+0000","last_undegraded":"2024-04-25T10:39:06.371805+0000","last_fullsized":"2024-04-25T10:39:06.371805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263444+0000","last_change":"2024-04-25T10:38:59.376270+0000","last_active":"2024-04-25T10:39:06.263444+0000","last_peered":"2024-04-25T10:39:06.263444+0000","last_clean":"2024-04-25T10:39:06.263444+0000","last_became_active":"2024-04-25T10:38:59.375839+0000","last_became_peered":"2024-04-25T10:38:59.375839+0000","last_unstale":"2024-04-25T10:39:06.263444+0000","last_undegraded":"2024-04-25T10:39:06.263444+0000","last_fullsized":"2024-04-25T10:39:06.263444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:43.103655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407337+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T10:39:06.407337+0000","last_peered":"2024-04-25T10:39:06.407337+0000","last_clean":"2024-04-25T10:39:06.407337+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T10:39:06.407337+0000","last_undegraded":"2024-04-25T10:39:06.407337+0000","last_fullsized":"2024-04-25T10:39:06.407337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378738+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T10:39:05.378738+0000","last_peered":"2024-04-25T10:39:05.378738+0000","last_clean":"2024-04-25T10:39:05.378738+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T10:39:05.378738+0000","last_undegraded":"2024-04-25T10:39:05.378738+0000","last_fullsized":"2024-04-25T10:39:05.378738+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262545+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T10:39:06.262545+0000","last_peered":"2024-04-25T10:39:06.262545+0000","last_clean":"2024-04-25T10:39:06.262545+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T10:39:06.262545+0000","last_undegraded":"2024-04-25T10:39:06.262545+0000","last_fullsized":"2024-04-25T10:39:06.262545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.410312+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T10:39:06.410312+0000","last_peered":"2024-04-25T10:39:06.410312+0000","last_clean":"2024-04-25T10:39:06.410312+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T10:39:06.410312+0000","last_undegraded":"2024-04-25T10:39:06.410312+0000","last_fullsized":"2024-04-25T10:39:06.410312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407296+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T10:39:06.407296+0000","last_peered":"2024-04-25T10:39:06.407296+0000","last_clean":"2024-04-25T10:39:06.407296+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T10:39:06.407296+0000","last_undegraded":"2024-04-25T10:39:06.407296+0000","last_fullsized":"2024-04-25T10:39:06.407296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263350+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T10:39:06.263350+0000","last_peered":"2024-04-25T10:39:06.263350+0000","last_clean":"2024-04-25T10:39:06.263350+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T10:39:06.263350+0000","last_undegraded":"2024-04-25T10:39:06.263350+0000","last_fullsized":"2024-04-25T10:39:06.263350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813380+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T10:39:24.813380+0000","last_peered":"2024-04-25T10:39:24.813380+0000","last_clean":"2024-04-25T10:39:24.813380+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T10:39:24.813380+0000","last_undegraded":"2024-04-25T10:39:24.813380+0000","last_fullsized":"2024-04-25T10:39:24.813380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371797+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T10:39:06.371797+0000","last_peered":"2024-04-25T10:39:06.371797+0000","last_clean":"2024-04-25T10:39:06.371797+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T10:39:06.371797+0000","last_undegraded":"2024-04-25T10:39:06.371797+0000","last_fullsized":"2024-04-25T10:39:06.371797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379998+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T10:39:05.379998+0000","last_peered":"2024-04-25T10:39:05.379998+0000","last_clean":"2024-04-25T10:39:05.379998+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T10:39:05.379998+0000","last_undegraded":"2024-04-25T10:39:05.379998+0000","last_fullsized":"2024-04-25T10:39:05.379998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812430+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T10:39:24.812430+0000","last_peered":"2024-04-25T10:39:24.812430+0000","last_clean":"2024-04-25T10:39:24.812430+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T10:39:24.812430+0000","last_undegraded":"2024-04-25T10:39:24.812430+0000","last_fullsized":"2024-04-25T10:39:24.812430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376592+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T10:39:05.376592+0000","last_peered":"2024-04-25T10:39:05.376592+0000","last_clean":"2024-04-25T10:39:05.376592+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T10:39:05.376592+0000","last_undegraded":"2024-04-25T10:39:05.376592+0000","last_fullsized":"2024-04-25T10:39:05.376592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262028+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T10:39:06.262028+0000","last_peered":"2024-04-25T10:39:06.262028+0000","last_clean":"2024-04-25T10:39:06.262028+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T10:39:06.262028+0000","last_undegraded":"2024-04-25T10:39:06.262028+0000","last_fullsized":"2024-04-25T10:39:06.262028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.804398+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T10:39:23.804398+0000","last_peered":"2024-04-25T10:39:23.804398+0000","last_clean":"2024-04-25T10:39:23.804398+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T10:39:23.804398+0000","last_undegraded":"2024-04-25T10:39:23.804398+0000","last_fullsized":"2024-04-25T10:39:23.804398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376022+0000","last_change":"2024-04-25T10:39:04.075730+0000","last_active":"2024-04-25T10:39:05.376022+0000","last_peered":"2024-04-25T10:39:05.376022+0000","last_clean":"2024-04-25T10:39:05.376022+0000","last_became_active":"2024-04-25T10:39:04.074100+0000","last_became_peered":"2024-04-25T10:39:04.074100+0000","last_unstale":"2024-04-25T10:39:05.376022+0000","last_undegraded":"2024-04-25T10:39:05.376022+0000","last_fullsized":"2024-04-25T10:39:05.376022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371541+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T10:39:06.371541+0000","last_peered":"2024-04-25T10:39:06.371541+0000","last_clean":"2024-04-25T10:39:06.371541+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T10:39:06.371541+0000","last_undegraded":"2024-04-25T10:39:06.371541+0000","last_fullsized":"2024-04-25T10:39:06.371541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.813673+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T10:39:24.813673+0000","last_peered":"2024-04-25T10:39:24.813673+0000","last_clean":"2024-04-25T10:39:24.813673+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T10:39:24.813673+0000","last_undegraded":"2024-04-25T10:39:24.813673+0000","last_fullsized":"2024-04-25T10:39:24.813673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380495+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T10:39:05.380495+0000","last_peered":"2024-04-25T10:39:05.380495+0000","last_clean":"2024-04-25T10:39:05.380495+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T10:39:05.380495+0000","last_undegraded":"2024-04-25T10:39:05.380495+0000","last_fullsized":"2024-04-25T10:39:05.380495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261538+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T10:39:06.261538+0000","last_peered":"2024-04-25T10:39:06.261538+0000","last_clean":"2024-04-25T10:39:06.261538+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T10:39:06.261538+0000","last_undegraded":"2024-04-25T10:39:06.261538+0000","last_fullsized":"2024-04-25T10:39:06.261538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'12","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.801119+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T10:39:23.801119+0000","last_peered":"2024-04-25T10:39:23.801119+0000","last_clean":"2024-04-25T10:39:23.801119+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T10:39:23.801119+0000","last_undegraded":"2024-04-25T10:39:23.801119+0000","last_fullsized":"2024-04-25T10:39:23.801119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450574+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T10:39:06.450574+0000","last_peered":"2024-04-25T10:39:06.450574+0000","last_clean":"2024-04-25T10:39:06.450574+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T10:39:06.450574+0000","last_undegraded":"2024-04-25T10:39:06.450574+0000","last_fullsized":"2024-04-25T10:39:06.450574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409684+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T10:39:06.409684+0000","last_peered":"2024-04-25T10:39:06.409684+0000","last_clean":"2024-04-25T10:39:06.409684+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T10:39:06.409684+0000","last_undegraded":"2024-04-25T10:39:06.409684+0000","last_fullsized":"2024-04-25T10:39:06.409684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450019+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T10:39:06.450019+0000","last_peered":"2024-04-25T10:39:06.450019+0000","last_clean":"2024-04-25T10:39:06.450019+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T10:39:06.450019+0000","last_undegraded":"2024-04-25T10:39:06.450019+0000","last_fullsized":"2024-04-25T10:39:06.450019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409205+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T10:39:06.409205+0000","last_peered":"2024-04-25T10:39:06.409205+0000","last_clean":"2024-04-25T10:39:06.409205+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T10:39:06.409205+0000","last_undegraded":"2024-04-25T10:39:06.409205+0000","last_fullsized":"2024-04-25T10:39:06.409205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.372045+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T10:39:06.372045+0000","last_peered":"2024-04-25T10:39:06.372045+0000","last_clean":"2024-04-25T10:39:06.372045+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T10:39:06.372045+0000","last_undegraded":"2024-04-25T10:39:06.372045+0000","last_fullsized":"2024-04-25T10:39:06.372045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.807641+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T10:39:23.807641+0000","last_peered":"2024-04-25T10:39:23.807641+0000","last_clean":"2024-04-25T10:39:23.807641+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T10:39:23.807641+0000","last_undegraded":"2024-04-25T10:39:23.807641+0000","last_fullsized":"2024-04-25T10:39:23.807641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375418+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T10:39:05.375418+0000","last_peered":"2024-04-25T10:39:05.375418+0000","last_clean":"2024-04-25T10:39:05.375418+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T10:39:05.375418+0000","last_undegraded":"2024-04-25T10:39:05.375418+0000","last_fullsized":"2024-04-25T10:39:05.375418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382417+0000","last_change":"2024-04-25T10:38:59.353750+0000","last_active":"2024-04-25T10:39:05.382417+0000","last_peered":"2024-04-25T10:39:05.382417+0000","last_clean":"2024-04-25T10:39:05.382417+0000","last_became_active":"2024-04-25T10:38:59.353056+0000","last_became_peered":"2024-04-25T10:38:59.353056+0000","last_unstale":"2024-04-25T10:39:05.382417+0000","last_undegraded":"2024-04-25T10:39:05.382417+0000","last_fullsized":"2024-04-25T10:39:05.382417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.808876+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T10:39:23.808876+0000","last_peered":"2024-04-25T10:39:23.808876+0000","last_clean":"2024-04-25T10:39:23.808876+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T10:39:23.808876+0000","last_undegraded":"2024-04-25T10:39:23.808876+0000","last_fullsized":"2024-04-25T10:39:23.808876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375377+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T10:39:05.375377+0000","last_peered":"2024-04-25T10:39:05.375377+0000","last_clean":"2024-04-25T10:39:05.375377+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T10:39:05.375377+0000","last_undegraded":"2024-04-25T10:39:05.375377+0000","last_fullsized":"2024-04-25T10:39:05.375377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371727+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T10:39:06.371727+0000","last_peered":"2024-04-25T10:39:06.371727+0000","last_clean":"2024-04-25T10:39:06.371727+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T10:39:06.371727+0000","last_undegraded":"2024-04-25T10:39:06.371727+0000","last_fullsized":"2024-04-25T10:39:06.371727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450212+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T10:39:06.450212+0000","last_peered":"2024-04-25T10:39:06.450212+0000","last_clean":"2024-04-25T10:39:06.450212+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T10:39:06.450212+0000","last_undegraded":"2024-04-25T10:39:06.450212+0000","last_fullsized":"2024-04-25T10:39:06.450212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.381633+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T10:39:05.381633+0000","last_peered":"2024-04-25T10:39:05.381633+0000","last_clean":"2024-04-25T10:39:05.381633+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T10:39:05.381633+0000","last_undegraded":"2024-04-25T10:39:05.381633+0000","last_fullsized":"2024-04-25T10:39:05.381633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383599+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T10:39:05.383599+0000","last_peered":"2024-04-25T10:39:05.383599+0000","last_clean":"2024-04-25T10:39:05.383599+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T10:39:05.383599+0000","last_undegraded":"2024-04-25T10:39:05.383599+0000","last_fullsized":"2024-04-25T10:39:05.383599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375402+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T10:39:05.375402+0000","last_peered":"2024-04-25T10:39:05.375402+0000","last_clean":"2024-04-25T10:39:05.375402+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T10:39:05.375402+0000","last_undegraded":"2024-04-25T10:39:05.375402+0000","last_fullsized":"2024-04-25T10:39:05.375402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.812861+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T10:39:24.812861+0000","last_peered":"2024-04-25T10:39:24.812861+0000","last_clean":"2024-04-25T10:39:24.812861+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T10:39:24.812861+0000","last_undegraded":"2024-04-25T10:39:24.812861+0000","last_fullsized":"2024-04-25T10:39:24.812861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:24.811253+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T10:39:24.811253+0000","last_peered":"2024-04-25T10:39:24.811253+0000","last_clean":"2024-04-25T10:39:24.811253+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T10:39:24.811253+0000","last_undegraded":"2024-04-25T10:39:24.811253+0000","last_fullsized":"2024-04-25T10:39:24.811253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371915+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T10:39:06.371915+0000","last_peered":"2024-04-25T10:39:06.371915+0000","last_clean":"2024-04-25T10:39:06.371915+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T10:39:06.371915+0000","last_undegraded":"2024-04-25T10:39:06.371915+0000","last_fullsized":"2024-04-25T10:39:06.371915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407786+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T10:39:06.407786+0000","last_peered":"2024-04-25T10:39:06.407786+0000","last_clean":"2024-04-25T10:39:06.407786+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T10:39:06.407786+0000","last_undegraded":"2024-04-25T10:39:06.407786+0000","last_fullsized":"2024-04-25T10:39:06.407786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:23.810784+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T10:39:23.810784+0000","last_peered":"2024-04-25T10:39:23.810784+0000","last_clean":"2024-04-25T10:39:23.810784+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T10:39:23.810784+0000","last_undegraded":"2024-04-25T10:39:23.810784+0000","last_fullsized":"2024-04-25T10:39:23.810784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.408790+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T10:39:06.408790+0000","last_peered":"2024-04-25T10:39:06.408790+0000","last_clean":"2024-04-25T10:39:06.408790+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T10:39:06.408790+0000","last_undegraded":"2024-04-25T10:39:06.408790+0000","last_fullsized":"2024-04-25T10:39:06.408790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376153+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T10:39:05.376153+0000","last_peered":"2024-04-25T10:39:05.376153+0000","last_clean":"2024-04-25T10:39:05.376153+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T10:39:05.376153+0000","last_undegraded":"2024-04-25T10:39:05.376153+0000","last_fullsized":"2024-04-25T10:39:05.376153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379483+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T10:39:05.379483+0000","last_peered":"2024-04-25T10:39:05.379483+0000","last_clean":"2024-04-25T10:39:05.379483+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T10:39:05.379483+0000","last_undegraded":"2024-04-25T10:39:05.379483+0000","last_fullsized":"2024-04-25T10:39:05.379483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407574+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T10:39:06.407574+0000","last_peered":"2024-04-25T10:39:06.407574+0000","last_clean":"2024-04-25T10:39:06.407574+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T10:39:06.407574+0000","last_undegraded":"2024-04-25T10:39:06.407574+0000","last_fullsized":"2024-04-25T10:39:06.407574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380900+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T10:39:05.380900+0000","last_peered":"2024-04-25T10:39:05.380900+0000","last_clean":"2024-04-25T10:39:05.380900+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T10:39:05.380900+0000","last_undegraded":"2024-04-25T10:39:05.380900+0000","last_fullsized":"2024-04-25T10:39:05.380900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371754+0000","last_change":"2024-04-25T10:38:59.335488+0000","last_active":"2024-04-25T10:39:06.371754+0000","last_peered":"2024-04-25T10:39:06.371754+0000","last_clean":"2024-04-25T10:39:06.371754+0000","last_became_active":"2024-04-25T10:38:59.335116+0000","last_became_peered":"2024-04-25T10:38:59.335116+0000","last_unstale":"2024-04-25T10:39:06.371754+0000","last_undegraded":"2024-04-25T10:39:06.371754+0000","last_fullsized":"2024-04-25T10:39:06.371754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376240+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T10:39:05.376240+0000","last_peered":"2024-04-25T10:39:05.376240+0000","last_clean":"2024-04-25T10:39:05.376240+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T10:39:05.376240+0000","last_undegraded":"2024-04-25T10:39:05.376240+0000","last_fullsized":"2024-04-25T10:39:05.376240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450833+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T10:39:06.450833+0000","last_peered":"2024-04-25T10:39:06.450833+0000","last_clean":"2024-04-25T10:39:06.450833+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T10:39:06.450833+0000","last_undegraded":"2024-04-25T10:39:06.450833+0000","last_fullsized":"2024-04-25T10:39:06.450833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384578+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T10:39:05.384578+0000","last_peered":"2024-04-25T10:39:05.384578+0000","last_clean":"2024-04-25T10:39:05.384578+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T10:39:05.384578+0000","last_undegraded":"2024-04-25T10:39:05.384578+0000","last_fullsized":"2024-04-25T10:39:05.384578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376701+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T10:39:05.376701+0000","last_peered":"2024-04-25T10:39:05.376701+0000","last_clean":"2024-04-25T10:39:05.376701+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T10:39:05.376701+0000","last_undegraded":"2024-04-25T10:39:05.376701+0000","last_fullsized":"2024-04-25T10:39:05.376701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.379166+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T10:39:05.379166+0000","last_peered":"2024-04-25T10:39:05.379166+0000","last_clean":"2024-04-25T10:39:05.379166+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T10:39:05.379166+0000","last_undegraded":"2024-04-25T10:39:05.379166+0000","last_fullsized":"2024-04-25T10:39:05.379166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375532+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T10:39:05.375532+0000","last_peered":"2024-04-25T10:39:05.375532+0000","last_clean":"2024-04-25T10:39:05.375532+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T10:39:05.375532+0000","last_undegraded":"2024-04-25T10:39:05.375532+0000","last_fullsized":"2024-04-25T10:39:05.375532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380616+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T10:39:05.380616+0000","last_peered":"2024-04-25T10:39:05.380616+0000","last_clean":"2024-04-25T10:39:05.380616+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T10:39:05.380616+0000","last_undegraded":"2024-04-25T10:39:05.380616+0000","last_fullsized":"2024-04-25T10:39:05.380616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371579+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T10:39:06.371579+0000","last_peered":"2024-04-25T10:39:06.371579+0000","last_clean":"2024-04-25T10:39:06.371579+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T10:39:06.371579+0000","last_undegraded":"2024-04-25T10:39:06.371579+0000","last_fullsized":"2024-04-25T10:39:06.371579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384073+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T10:39:05.384073+0000","last_peered":"2024-04-25T10:39:05.384073+0000","last_clean":"2024-04-25T10:39:05.384073+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T10:39:05.384073+0000","last_undegraded":"2024-04-25T10:39:05.384073+0000","last_fullsized":"2024-04-25T10:39:05.384073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262884+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T10:39:06.262884+0000","last_peered":"2024-04-25T10:39:06.262884+0000","last_clean":"2024-04-25T10:39:06.262884+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T10:39:06.262884+0000","last_undegraded":"2024-04-25T10:39:06.262884+0000","last_fullsized":"2024-04-25T10:39:06.262884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.407870+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T10:39:06.407870+0000","last_peered":"2024-04-25T10:39:06.407870+0000","last_clean":"2024-04-25T10:39:06.407870+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T10:39:06.407870+0000","last_undegraded":"2024-04-25T10:39:06.407870+0000","last_fullsized":"2024-04-25T10:39:06.407870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382695+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T10:39:05.382695+0000","last_peered":"2024-04-25T10:39:05.382695+0000","last_clean":"2024-04-25T10:39:05.382695+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T10:39:05.382695+0000","last_undegraded":"2024-04-25T10:39:05.382695+0000","last_fullsized":"2024-04-25T10:39:05.382695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.378766+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T10:39:05.378766+0000","last_peered":"2024-04-25T10:39:05.378766+0000","last_clean":"2024-04-25T10:39:05.378766+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T10:39:05.378766+0000","last_undegraded":"2024-04-25T10:39:05.378766+0000","last_fullsized":"2024-04-25T10:39:05.378766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.450284+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T10:39:06.450284+0000","last_peered":"2024-04-25T10:39:06.450284+0000","last_clean":"2024-04-25T10:39:06.450284+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T10:39:06.450284+0000","last_undegraded":"2024-04-25T10:39:06.450284+0000","last_fullsized":"2024-04-25T10:39:06.450284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371478+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T10:39:06.371478+0000","last_peered":"2024-04-25T10:39:06.371478+0000","last_clean":"2024-04-25T10:39:06.371478+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T10:39:06.371478+0000","last_undegraded":"2024-04-25T10:39:06.371478+0000","last_fullsized":"2024-04-25T10:39:06.371478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.376036+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T10:39:05.376036+0000","last_peered":"2024-04-25T10:39:05.376036+0000","last_clean":"2024-04-25T10:39:05.376036+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T10:39:05.376036+0000","last_undegraded":"2024-04-25T10:39:05.376036+0000","last_fullsized":"2024-04-25T10:39:05.376036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.409436+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T10:39:06.409436+0000","last_peered":"2024-04-25T10:39:06.409436+0000","last_clean":"2024-04-25T10:39:06.409436+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T10:39:06.409436+0000","last_undegraded":"2024-04-25T10:39:06.409436+0000","last_fullsized":"2024-04-25T10:39:06.409436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.383406+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T10:39:05.383406+0000","last_peered":"2024-04-25T10:39:05.383406+0000","last_clean":"2024-04-25T10:39:05.383406+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T10:39:05.383406+0000","last_undegraded":"2024-04-25T10:39:05.383406+0000","last_fullsized":"2024-04-25T10:39:05.383406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.384611+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T10:39:05.384611+0000","last_peered":"2024-04-25T10:39:05.384611+0000","last_clean":"2024-04-25T10:39:05.384611+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T10:39:05.384611+0000","last_undegraded":"2024-04-25T10:39:05.384611+0000","last_fullsized":"2024-04-25T10:39:05.384611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.263214+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T10:39:06.263214+0000","last_peered":"2024-04-25T10:39:06.263214+0000","last_clean":"2024-04-25T10:39:06.263214+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T10:39:06.263214+0000","last_undegraded":"2024-04-25T10:39:06.263214+0000","last_fullsized":"2024-04-25T10:39:06.263214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.375273+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T10:39:05.375273+0000","last_peered":"2024-04-25T10:39:05.375273+0000","last_clean":"2024-04-25T10:39:05.375273+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T10:39:05.375273+0000","last_undegraded":"2024-04-25T10:39:05.375273+0000","last_fullsized":"2024-04-25T10:39:05.375273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262803+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T10:39:06.262803+0000","last_peered":"2024-04-25T10:39:06.262803+0000","last_clean":"2024-04-25T10:39:06.262803+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T10:39:06.262803+0000","last_undegraded":"2024-04-25T10:39:06.262803+0000","last_fullsized":"2024-04-25T10:39:06.262803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.380508+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T10:39:05.380508+0000","last_peered":"2024-04-25T10:39:05.380508+0000","last_clean":"2024-04-25T10:39:05.380508+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T10:39:05.380508+0000","last_undegraded":"2024-04-25T10:39:05.380508+0000","last_fullsized":"2024-04-25T10:39:05.380508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.261606+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T10:39:06.261606+0000","last_peered":"2024-04-25T10:39:06.261606+0000","last_clean":"2024-04-25T10:39:06.261606+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T10:39:06.261606+0000","last_undegraded":"2024-04-25T10:39:06.261606+0000","last_fullsized":"2024-04-25T10:39:06.261606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:05.382113+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T10:39:05.382113+0000","last_peered":"2024-04-25T10:39:05.382113+0000","last_clean":"2024-04-25T10:39:05.382113+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T10:39:05.382113+0000","last_undegraded":"2024-04-25T10:39:05.382113+0000","last_fullsized":"2024-04-25T10:39:05.382113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.371520+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T10:39:06.371520+0000","last_peered":"2024-04-25T10:39:06.371520+0000","last_clean":"2024-04-25T10:39:06.371520+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T10:39:06.371520+0000","last_undegraded":"2024-04-25T10:39:06.371520+0000","last_fullsized":"2024-04-25T10:39:06.371520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.451173+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T10:39:06.451173+0000","last_peered":"2024-04-25T10:39:06.451173+0000","last_clean":"2024-04-25T10:39:06.451173+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T10:39:06.451173+0000","last_undegraded":"2024-04-25T10:39:06.451173+0000","last_fullsized":"2024-04-25T10:39:06.451173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T10:39:06.262865+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T10:39:06.262865+0000","last_peered":"2024-04-25T10:39:06.262865+0000","last_clean":"2024-04-25T10:39:06.262865+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T10:39:06.262865+0000","last_undegraded":"2024-04-25T10:39:06.262865+0000","last_fullsized":"2024-04-25T10:39:06.262865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":703748,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":116584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":113442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":112778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":116618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":112882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":113008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":703092,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:39:32.333 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:39:32.333 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T10:39:32.333 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T10:39:32.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:39:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 Processor -- start 2024-04-25T10:39:32.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 -- start start 2024-04-25T10:39:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcb200c92d0 0x7fcb200c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb20153eb0 0x7fcb200c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.526 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb200c8850 0x7fcb200cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.519+0000 7fcb26c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcb200c5890 con 0x7fcb20153eb0 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb26c00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcb200c7e80 con 0x7fcb200c92d0 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb26c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcb201542c0 con 0x7fcb200c8850 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb20153eb0 0x7fcb200c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb20153eb0 0x7fcb200c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47052/0 (socket says 172.21.15.16:47052) 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 -- 172.21.15.16:0/346267355 learned_addr learned my addr 172.21.15.16:0/346267355 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb1fe00640 1 --2- 172.21.15.16:0/346267355 >> v2:172.21.15.186:3300/0 conn(0x7fcb200c92d0 0x7fcb200c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb24c00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb200c8850 0x7fcb200cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 -- 172.21.15.16:0/346267355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb200c8850 msgr2=0x7fcb200cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb200c8850 0x7fcb200cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 -- 172.21.15.16:0/346267355 >> v2:172.21.15.186:3300/0 conn(0x7fcb200c92d0 msgr2=0x7fcb200c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 --2- 172.21.15.16:0/346267355 >> v2:172.21.15.186:3300/0 conn(0x7fcb200c92d0 0x7fcb200c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.527 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 -- 172.21.15.16:0/346267355 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2015a360 con 0x7fcb20153eb0 2024-04-25T10:39:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb17e00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb20153eb0 0x7fcb200c8310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb20073000 tx=0x7fcb0801ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47483a9010d9ed57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.529 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb1f400640 1 -- 172.21.15.16:0/346267355 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a8af0 con 0x7fcb20153eb0 2024-04-25T10:39:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb1f400640 1 -- 172.21.15.16:0/346267355 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb080a8c90 con 0x7fcb20153eb0 2024-04-25T10:39:32.530 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.523+0000 7fcb1f400640 1 -- 172.21.15.16:0/346267355 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080b0660 con 0x7fcb20153eb0 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- 172.21.15.16:0/346267355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb20153eb0 msgr2=0x7fcb200c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb20153eb0 0x7fcb200c8310 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb20073000 tx=0x7fcb0801ee30 comp rx=0 tx=0).stop 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- 172.21.15.16:0/346267355 shutdown_connections 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb200c8850 0x7fcb200cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 --2- 172.21.15.16:0/346267355 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb20153eb0 0x7fcb200c8310 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 --2- 172.21.15.16:0/346267355 >> v2:172.21.15.186:3300/0 conn(0x7fcb200c92d0 0x7fcb200c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- 172.21.15.16:0/346267355 >> 172.21.15.16:0/346267355 conn(0x7fcb200739a0 msgr2=0x7fcb20073de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- 172.21.15.16:0/346267355 shutdown_connections 2024-04-25T10:39:32.531 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- 172.21.15.16:0/346267355 wait complete. 2024-04-25T10:39:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 Processor -- start 2024-04-25T10:39:32.533 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.527+0000 7fcb26c00640 1 -- start start 2024-04-25T10:39:32.534 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb200c8850 0x7fcb2014c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 0x7fcb201eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 0x7fcb20071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2015ac00 con 0x7fcb200c92d0 2024-04-25T10:39:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2015a920 con 0x7fcb200c8850 2024-04-25T10:39:32.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcb200cd6f0 con 0x7fcb20153eb0 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb24c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 0x7fcb20071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb1fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb200c8850 0x7fcb2014c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb24c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 0x7fcb20071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46818/0 (socket says 172.21.15.16:46818) 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb24c00640 1 -- 172.21.15.16:0/3307015416 learned_addr learned my addr 172.21.15.16:0/3307015416 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 0x7fcb201eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 -- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 msgr2=0x7fcb20071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 0x7fcb20071150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 -- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb200c8850 msgr2=0x7fcb2014c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb200c8850 0x7fcb2014c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 -- 172.21.15.16:0/3307015416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb201e77d0 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb17e00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 0x7fcb201eabc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb200c43f0 tx=0x7fcb0801bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080a88f0 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb080a8ab0 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08005be0 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb20151380 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2015c4c0 con 0x7fcb200c92d0 2024-04-25T10:39:32.537 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.531+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb200507c0 con 0x7fcb200c92d0 2024-04-25T10:39:32.538 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.535+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcb080c2020 con 0x7fcb200c92d0 2024-04-25T10:39:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.535+0000 7fcb1cc00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 0x7fcaf8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.535+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcb0812cf60 con 0x7fcb200c92d0 2024-04-25T10:39:32.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.535+0000 7fcb1fe00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 0x7fcaf8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.541 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.535+0000 7fcb1fe00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 0x7fcaf8071ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006fd0 tx=0x7fcb10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.539+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb08018990 con 0x7fcb200c92d0 2024-04-25T10:39:32.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.739+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcb200c6c30 con 0x7fcb200c92d0 2024-04-25T10:39:32.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.739+0000 7fcb1cc00640 1 -- 172.21.15.16:0/3307015416 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcb080a8c60 con 0x7fcb200c92d0 2024-04-25T10:39:32.745 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:32.745 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:39:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 msgr2=0x7fcaf8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 0x7fcaf8071ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb10006fd0 tx=0x7fcb10008040 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 msgr2=0x7fcb201eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 0x7fcb201eabc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb200c43f0 tx=0x7fcb0801bbd0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 shutdown_connections 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcaf806f5a0 0x7fcaf8071ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb20153eb0 0x7fcb20071150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb200c92d0 0x7fcb201eabc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 --2- 172.21.15.16:0/3307015416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb200c8850 0x7fcb2014c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 >> 172.21.15.16:0/3307015416 conn(0x7fcb200739a0 msgr2=0x7fcb20151b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 shutdown_connections 2024-04-25T10:39:32.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.743+0000 7fcb26c00640 1 -- 172.21.15.16:0/3307015416 wait complete. 2024-04-25T10:39:32.768 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T10:39:32.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:32.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.915+0000 7fee58800640 1 Processor -- start 2024-04-25T10:39:32.920 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.915+0000 7fee58800640 1 -- start start 2024-04-25T10:39:32.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee58800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fee50153fc0 0x7fee500c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee58800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c4df0 0x7fee501647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.922 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee58800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee500ca9e0 con 0x7fee500c9190 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee58800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fee500c7c40 con 0x7fee50153fc0 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee58800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee500c7e90 con 0x7fee500c4df0 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fee50153fc0 0x7fee500c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fee50153fc0 0x7fee500c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47064/0 (socket says 172.21.15.16:47064) 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 -- 172.21.15.16:0/3282228341 learned_addr learned my addr 172.21.15.16:0/3282228341 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee56800640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c4df0 0x7fee501647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 -- 172.21.15.16:0/3282228341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c4df0 msgr2=0x7fee501647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c4df0 0x7fee501647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 -- 172.21.15.16:0/3282228341 >> v1:172.21.15.186:6789/0 conn(0x7fee500c9190 legacy=0x7fee500c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 -- 172.21.15.16:0/3282228341 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee500c8170 con 0x7fee50153fc0 2024-04-25T10:39:32.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.919+0000 7fee55e00640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee50153fc0 0x7fee500c8c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee500c7dc0 tx=0x7fee4401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604f07b4c7cb42b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee54a00640 1 -- 172.21.15.16:0/3282228341 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee440ab660 con 0x7fee50153fc0 2024-04-25T10:39:32.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee54a00640 1 -- 172.21.15.16:0/3282228341 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee440b0070 con 0x7fee50153fc0 2024-04-25T10:39:32.926 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee54a00640 1 -- 172.21.15.16:0/3282228341 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee440aba60 con 0x7fee50153fc0 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- 172.21.15.16:0/3282228341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee50153fc0 msgr2=0x7fee500c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee50153fc0 0x7fee500c8c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee500c7dc0 tx=0x7fee4401c660 comp rx=0 tx=0).stop 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- 172.21.15.16:0/3282228341 shutdown_connections 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c4df0 0x7fee501647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 --2- 172.21.15.16:0/3282228341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee50153fc0 0x7fee500c8c50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- 172.21.15.16:0/3282228341 >> 172.21.15.16:0/3282228341 conn(0x7fee500cdc80 msgr2=0x7fee500c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- 172.21.15.16:0/3282228341 shutdown_connections 2024-04-25T10:39:32.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- 172.21.15.16:0/3282228341 wait complete. 2024-04-25T10:39:32.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 Processor -- start 2024-04-25T10:39:32.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.923+0000 7fee58800640 1 -- start start 2024-04-25T10:39:32.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 0x7fee50150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 0x7fee501ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fee50154550 con 0x7fee500c4df0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee501543d0 con 0x7fee50153fc0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee500ca5a0 con 0x7fee500c9190 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47070/0 (socket says 172.21.15.16:47070) 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 -- 172.21.15.16:0/2354829862 learned_addr learned my addr 172.21.15.16:0/2354829862 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55400640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 0x7fee50150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee56800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 0x7fee501ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 -- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 msgr2=0x7fee50150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 0x7fee50150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 -- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 msgr2=0x7fee501ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 0x7fee501ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 -- 172.21.15.16:0/2354829862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50163e20 con 0x7fee500c4df0 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55400640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 0x7fee50150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:32.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee56800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 0x7fee501ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee55e00640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee440ad040 tx=0x7fee4401aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee440be610 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee440be7b0 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee440beba0 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5015ef40 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee501fa910 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.927+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee50050750 con 0x7fee500c4df0 2024-04-25T10:39:32.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.931+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee440bc020 con 0x7fee500c4df0 2024-04-25T10:39:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.931+0000 7fee4a000640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 0x7fee2c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:32.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.931+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fee44129be0 con 0x7fee500c4df0 2024-04-25T10:39:32.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.931+0000 7fee55400640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 0x7fee2c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:32.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.931+0000 7fee55400640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 0x7fee2c071ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee501f7610 tx=0x7fee40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:32.940 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:32.935+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee50163e20 con 0x7fee500c4df0 2024-04-25T10:39:33.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.103+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee5006e1f0 con 0x7fee500c4df0 2024-04-25T10:39:33.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.103+0000 7fee4a000640 1 -- 172.21.15.16:0/2354829862 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fee44016250 con 0x7fee500c4df0 2024-04-25T10:39:33.109 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:33.109 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 msgr2=0x7fee2c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 0x7fee2c071ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fee501f7610 tx=0x7fee40009040 comp rx=0 tx=0).stop 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 msgr2=0x7fee5015ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee440ad040 tx=0x7fee4401aea0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 shutdown_connections 2024-04-25T10:39:33.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee2c06f5d0 0x7fee2c071ae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee50153fc0 0x7fee501ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee500c9190 0x7fee50150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 --2- 172.21.15.16:0/2354829862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee500c4df0 0x7fee5015ea00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 >> 172.21.15.16:0/2354829862 conn(0x7fee500cdc80 msgr2=0x7fee5015cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 shutdown_connections 2024-04-25T10:39:33.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.107+0000 7fee58800640 1 -- 172.21.15.16:0/2354829862 wait complete. 2024-04-25T10:39:33.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:38:56.312069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:38:57.697392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:39:01.362964+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:39:33.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:39:33.287 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 Processor -- start 2024-04-25T10:39:33.288 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 -- start start 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 0x7f3ef00c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ef015a660 0x7f3ef00c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ef00c6400 con 0x7f3ef0153800 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f3ef00c6d10 con 0x7f3ef015a660 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef6400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef00c76e0 con 0x7f3ef00c8240 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ee7e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3ef015a660 0x7f3ef00c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.290 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef5a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3ef0153800 0x7f3ef015d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38556/0 (socket says 172.21.15.16:38556) 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef5a00640 1 -- 172.21.15.16:0/3422931346 learned_addr learned my addr 172.21.15.16:0/3422931346 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.283+0000 7f3ef5000640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 0x7f3ef00c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ee7e00640 1 -- 172.21.15.16:0/3422931346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 msgr2=0x7f3ef00c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 0x7f3ef00c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ee7e00640 1 -- 172.21.15.16:0/3422931346 >> v1:172.21.15.16:6789/0 conn(0x7f3ef0153800 legacy=0x7f3ef015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ee7e00640 1 -- 172.21.15.16:0/3422931346 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef006dd10 con 0x7f3ef015a660 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ef5000640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 0x7f3ef00c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:33.291 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3eefe00640 1 -- 172.21.15.16:0/3422931346 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182970129 0 0) 0x7f3ef00c6400 con 0x7f3ef0153800 2024-04-25T10:39:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef015a660 0x7f3ef00c4e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009900 tx=0x7f3ed801ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b75a244420a6388 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3eefe00640 1 -- 172.21.15.16:0/3422931346 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80b5070 con 0x7f3ef015a660 2024-04-25T10:39:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3eefe00640 1 -- 172.21.15.16:0/3422931346 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed80a8a90 con 0x7f3ef015a660 2024-04-25T10:39:33.293 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.287+0000 7f3eefe00640 1 -- 172.21.15.16:0/3422931346 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a8e60 con 0x7f3ef015a660 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- 172.21.15.16:0/3422931346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef015a660 msgr2=0x7f3ef00c4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef015a660 0x7f3ef00c4e90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8009900 tx=0x7f3ed801ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- 172.21.15.16:0/3422931346 shutdown_connections 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef015a660 0x7f3ef00c4e90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 --2- 172.21.15.16:0/3422931346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef00c8240 0x7f3ef00c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- 172.21.15.16:0/3422931346 >> 172.21.15.16:0/3422931346 conn(0x7f3ef00ca340 msgr2=0x7f3ef00ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:33.294 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- 172.21.15.16:0/3422931346 shutdown_connections 2024-04-25T10:39:33.295 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- 172.21.15.16:0/3422931346 wait complete. 2024-04-25T10:39:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 Processor -- start 2024-04-25T10:39:33.296 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.291+0000 7f3ef6400640 1 -- start start 2024-04-25T10:39:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 0x7f3ef006c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef015a660 0x7f3ef006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00b9690 con 0x7f3ef00c8240 2024-04-25T10:39:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef00c69a0 con 0x7f3ef0153800 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef0075fd0 con 0x7f3ef015a660 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47090/0 (socket says 172.21.15.16:47090) 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 -- 172.21.15.16:0/2698466770 learned_addr learned my addr 172.21.15.16:0/2698466770 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 0x7f3ef006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5a00640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef015a660 0x7f3ef006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 -- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef015a660 msgr2=0x7f3ef006ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef015a660 0x7f3ef006ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 -- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 msgr2=0x7f3ef006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 0x7f3ef006c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 -- 172.21.15.16:0/2698466770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef00cd230 con 0x7f3ef00c8240 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 0x7f3ef006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef5000640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000e850 tx=0x7f3ee000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0017070 con 0x7f3ef00c8240 2024-04-25T10:39:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee000c8d0 con 0x7f3ef00c8240 2024-04-25T10:39:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000f040 con 0x7f3ef00c8240 2024-04-25T10:39:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef01fa440 con 0x7f3ef00c8240 2024-04-25T10:39:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef01f9720 con 0x7f3ef00c8240 2024-04-25T10:39:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef0076d30 con 0x7f3ef00c8240 2024-04-25T10:39:33.301 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.295+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3ee001a070 con 0x7f3ef00c8240 2024-04-25T10:39:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.299+0000 7f3eed600640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 0x7f3ec8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.302 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.299+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3ee008f370 con 0x7f3ef00c8240 2024-04-25T10:39:33.303 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.299+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 0x7f3ec8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.304 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.299+0000 7f3ee7e00640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 0x7f3ec8071ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80b2000 tx=0x7f3ed8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.307 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.303+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ef00cd230 con 0x7f3ef00c8240 2024-04-25T10:39:33.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.471+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3ef00009a0 con 0x7f3ef00c8240 2024-04-25T10:39:33.476 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.471+0000 7f3eed600640 1 -- 172.21.15.16:0/2698466770 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f3ee005be40 con 0x7f3ef00c8240 2024-04-25T10:39:33.477 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 msgr2=0x7f3ec8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 0x7f3ec8071ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80b2000 tx=0x7f3ed8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 msgr2=0x7f3ef01f9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000e850 tx=0x7f3ee000ed10 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 shutdown_connections 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f3ec806f5a0 0x7f3ec8071ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ef015a660 0x7f3ef006ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ef0153800 0x7f3ef006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 --2- 172.21.15.16:0/2698466770 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ef00c8240 0x7f3ef01f9f00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.479 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 >> 172.21.15.16:0/2698466770 conn(0x7f3ef00ca340 msgr2=0x7f3ef014ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:33.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 shutdown_connections 2024-04-25T10:39:33.480 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.475+0000 7f3ef6400640 1 -- 172.21.15.16:0/2698466770 wait complete. 2024-04-25T10:39:33.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:39:33.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 Processor -- start 2024-04-25T10:39:33.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 -- start start 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 0x7f28380caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2838162730 0x7f2838164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28380ca720 con 0x7f28380c56d0 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f28380c5200 con 0x7f2838162730 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283fe00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f28380c9df0 con 0x7f28380cab70 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283d400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f28380c56d0 0x7f28380c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38562/0 (socket says 172.21.15.16:38562) 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283d400640 1 -- 172.21.15.16:0/2079067880 learned_addr learned my addr 172.21.15.16:0/2079067880 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283ca00640 1 --2- 172.21.15.16:0/2079067880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 0x7f28380caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283de00640 1 --2- 172.21.15.16:0/2079067880 >> v2:172.21.15.186:3300/0 conn(0x7f2838162730 0x7f2838164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f2837e00640 1 -- 172.21.15.16:0/2079067880 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700422034 0 0) 0x7f28380ca720 con 0x7f28380c56d0 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f2837e00640 1 -- 172.21.15.16:0/2079067880 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28200035c0 con 0x7f28380c56d0 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283ca00640 1 -- 172.21.15.16:0/2079067880 >> v2:172.21.15.186:3300/0 conn(0x7f2838162730 msgr2=0x7f2838164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283ca00640 1 --2- 172.21.15.16:0/2079067880 >> v2:172.21.15.186:3300/0 conn(0x7f2838162730 0x7f2838164b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283ca00640 1 -- 172.21.15.16:0/2079067880 >> v1:172.21.15.16:6789/0 conn(0x7f28380c56d0 legacy=0x7f28380c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.658 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.651+0000 7f283ca00640 1 -- 172.21.15.16:0/2079067880 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283815e140 con 0x7f28380cab70 2024-04-25T10:39:33.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.655+0000 7f283ca00640 1 --2- 172.21.15.16:0/2079067880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 0x7f28380caf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2824009900 tx=0x7f282401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fee604b262e88ab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.655+0000 7f2837e00640 1 -- 172.21.15.16:0/2079067880 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240b1070 con 0x7f28380cab70 2024-04-25T10:39:33.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.655+0000 7f2837e00640 1 -- 172.21.15.16:0/2079067880 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28240ac600 con 0x7f28380cab70 2024-04-25T10:39:33.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.655+0000 7f2837e00640 1 -- 172.21.15.16:0/2079067880 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240aca10 con 0x7f28380cab70 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- 172.21.15.16:0/2079067880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 msgr2=0x7f28380caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 --2- 172.21.15.16:0/2079067880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 0x7f28380caf80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2824009900 tx=0x7f282401c5a0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- 172.21.15.16:0/2079067880 shutdown_connections 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 --2- 172.21.15.16:0/2079067880 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f28380cab70 0x7f28380caf80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 --2- 172.21.15.16:0/2079067880 >> v2:172.21.15.186:3300/0 conn(0x7f2838162730 0x7f2838164b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- 172.21.15.16:0/2079067880 >> 172.21.15.16:0/2079067880 conn(0x7f283806dd80 msgr2=0x7f2838072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- 172.21.15.16:0/2079067880 shutdown_connections 2024-04-25T10:39:33.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- 172.21.15.16:0/2079067880 wait complete. 2024-04-25T10:39:33.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 Processor -- start 2024-04-25T10:39:33.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.659+0000 7f283fe00640 1 -- start start 2024-04-25T10:39:33.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28380c56d0 0x7f283814b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2838162730 0x7f283815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f28380ca320 con 0x7f28380cab70 2024-04-25T10:39:33.670 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f28380c5ae0 con 0x7f28380c56d0 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f283815dde0 con 0x7f2838162730 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47102/0 (socket says 172.21.15.16:47102) 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 -- 172.21.15.16:0/1716081555 learned_addr learned my addr 172.21.15.16:0/1716081555 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 -- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2838162730 msgr2=0x7f283815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2838162730 0x7f283815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 -- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28380c56d0 msgr2=0x7f283814b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28380c56d0 0x7f283814b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 -- 172.21.15.16:0/1716081555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28381fab70 con 0x7f28380cab70 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283ca00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f282401a1d0 tx=0x7f282401ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240b1040 con 0x7f28380cab70 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28240ac400 con 0x7f28380cab70 2024-04-25T10:39:33.671 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28381fae50 con 0x7f28380cab70 2024-04-25T10:39:33.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824006e60 con 0x7f28380cab70 2024-04-25T10:39:33.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28381fb410 con 0x7f28380cab70 2024-04-25T10:39:33.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2838050750 con 0x7f28380cab70 2024-04-25T10:39:33.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.663+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f28240be020 con 0x7f28380cab70 2024-04-25T10:39:33.672 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.667+0000 7f2835600640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 0x7f2814071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:33.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.667+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2824129170 con 0x7f28380cab70 2024-04-25T10:39:33.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.667+0000 7f283d400640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 0x7f2814071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:33.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.667+0000 7f283d400640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 0x7f2814071ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28380cb7b0 tx=0x7f282c001100 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:33.675 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.671+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2824016190 con 0x7f28380cab70 2024-04-25T10:39:33.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f28380ca8f0 con 0x7f28380cab70 2024-04-25T10:39:33.840 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f2835600640 1 -- 172.21.15.16:0/1716081555 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f28240f5dc0 con 0x7f28380cab70 2024-04-25T10:39:33.840 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 msgr2=0x7f2814071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 0x7f2814071ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28380cb7b0 tx=0x7f282c001100 comp rx=0 tx=0).stop 2024-04-25T10:39:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 msgr2=0x7f283814dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f282401a1d0 tx=0x7f282401ade0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 shutdown_connections 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.835+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f281406f5a0 0x7f2814071ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2838162730 0x7f283815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28380cab70 0x7f283814dba0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 --2- 172.21.15.16:0/1716081555 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28380c56d0 0x7f283814b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 >> 172.21.15.16:0/1716081555 conn(0x7f283806dd80 msgr2=0x7f28380c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 shutdown_connections 2024-04-25T10:39:33.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:33.839+0000 7f283fe00640 1 -- 172.21.15.16:0/1716081555 wait complete. 2024-04-25T10:39:33.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:39:34.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.011+0000 7f4fe2400640 1 Processor -- start 2024-04-25T10:39:34.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.011+0000 7f4fe2400640 1 -- start start 2024-04-25T10:39:34.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc159db0 0x7f4fdc0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fdc0b2150 0x7f4fdc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4fdc06f250 0x7f4fdc15d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc0c2760 con 0x7f4fdc0b2150 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4fdc0c2480 con 0x7f4fdc06f250 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe2400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc0c2bc0 con 0x7f4fdc159db0 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fdc0b2150 0x7f4fdc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fdc0b2150 0x7f4fdc06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47110/0 (socket says 172.21.15.16:47110) 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 -- 172.21.15.16:0/943699702 learned_addr learned my addr 172.21.15.16:0/943699702 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe1000640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc159db0 0x7f4fdc0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fe1a00640 1 --2- 172.21.15.16:0/943699702 >> v2:172.21.15.186:3300/0 conn(0x7f4fdc06f250 0x7f4fdc15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 -- 172.21.15.16:0/943699702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc159db0 msgr2=0x7f4fdc0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc159db0 0x7f4fdc0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 -- 172.21.15.16:0/943699702 >> v2:172.21.15.186:3300/0 conn(0x7f4fdc06f250 msgr2=0x7f4fdc15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 --2- 172.21.15.16:0/943699702 >> v2:172.21.15.186:3300/0 conn(0x7f4fdc06f250 0x7f4fdc15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.015+0000 7f4fdbe00640 1 -- 172.21.15.16:0/943699702 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc0c2ea0 con 0x7f4fdc0b2150 2024-04-25T10:39:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fdbe00640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc0b2150 0x7f4fdc06ed10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc072fa0 tx=0x7f4fc801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec989682f9244fb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fdb400640 1 -- 172.21.15.16:0/943699702 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80b0070 con 0x7f4fdc0b2150 2024-04-25T10:39:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fdb400640 1 -- 172.21.15.16:0/943699702 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc80ab600 con 0x7f4fdc0b2150 2024-04-25T10:39:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fdb400640 1 -- 172.21.15.16:0/943699702 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80aba10 con 0x7f4fdc0b2150 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 -- 172.21.15.16:0/943699702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc0b2150 msgr2=0x7f4fdc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc0b2150 0x7f4fdc06ed10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc072fa0 tx=0x7f4fc801c380 comp rx=0 tx=0).stop 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 -- 172.21.15.16:0/943699702 shutdown_connections 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 --2- 172.21.15.16:0/943699702 >> v2:172.21.15.186:3300/0 conn(0x7f4fdc06f250 0x7f4fdc15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc0b2150 0x7f4fdc06ed10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 --2- 172.21.15.16:0/943699702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc159db0 0x7f4fdc0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 -- 172.21.15.16:0/943699702 >> 172.21.15.16:0/943699702 conn(0x7f4fdc0cd6c0 msgr2=0x7f4fdc0cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 -- 172.21.15.16:0/943699702 shutdown_connections 2024-04-25T10:39:34.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.019+0000 7f4fe2400640 1 -- 172.21.15.16:0/943699702 wait complete. 2024-04-25T10:39:34.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 Processor -- start 2024-04-25T10:39:34.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- start start 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fdc06f250 0x7f4fdc1fb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc0b2150 0x7f4fdc1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc0c2040 con 0x7f4fdc159db0 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc1544a0 con 0x7f4fdc06f250 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4fdc0c21c0 con 0x7f4fdc0b2150 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47126/0 (socket says 172.21.15.16:47126) 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 -- 172.21.15.16:0/1207310279 learned_addr learned my addr 172.21.15.16:0/1207310279 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:34.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1000640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fdc06f250 0x7f4fdc1fb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fdbe00640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc0b2150 0x7f4fdc1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 -- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc0b2150 msgr2=0x7f4fdc1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc0b2150 0x7f4fdc1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 -- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fdc06f250 msgr2=0x7f4fdc1fb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fdc06f250 0x7f4fdc1fb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 -- 172.21.15.16:0/1207310279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1fbb30 con 0x7f4fdc159db0 2024-04-25T10:39:34.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe1a00640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007e60 tx=0x7f4fd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4014620 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd4019070 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40149e0 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc15c6e0 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.023+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc15cca0 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.027+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc15c470 con 0x7f4fdc159db0 2024-04-25T10:39:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.027+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4fd4014c40 con 0x7f4fdc159db0 2024-04-25T10:39:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.027+0000 7f4fd8c00640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 0x7f4fb8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.027+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4fd408fee0 con 0x7f4fdc159db0 2024-04-25T10:39:34.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.027+0000 7f4fe1000640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 0x7f4fb8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.031+0000 7f4fe1000640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 0x7f4fb8071ae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0006fd0 tx=0x7f4fd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.031+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4fd405c360 con 0x7f4fdc159db0 2024-04-25T10:39:34.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.195+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4fdc1508e0 con 0x7f4fdc159db0 2024-04-25T10:39:34.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.195+0000 7f4fd8c00640 1 -- 172.21.15.16:0/1207310279 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f4fd4060660 con 0x7f4fdc159db0 2024-04-25T10:39:34.201 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-25T10:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 msgr2=0x7f4fb8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 0x7f4fb8071ae0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0006fd0 tx=0x7f4fd0008040 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 msgr2=0x7f4fdc149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007e60 tx=0x7f4fd400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 shutdown_connections 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4fb806f5d0 0x7f4fb8071ae0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fdc159db0 0x7f4fdc149b20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fdc0b2150 0x7f4fdc1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 --2- 172.21.15.16:0/1207310279 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fdc06f250 0x7f4fdc1fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 >> 172.21.15.16:0/1207310279 conn(0x7f4fdc0cd6c0 msgr2=0x7f4fdc157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 shutdown_connections 2024-04-25T10:39:34.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.199+0000 7f4fe2400640 1 -- 172.21.15.16:0/1207310279 wait complete. 2024-04-25T10:39:34.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:39:34.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 Processor -- start 2024-04-25T10:39:34.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 -- start start 2024-04-25T10:39:34.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fba8006e460 0x7fba800cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba800cc670 0x7fba800c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba800c7740 con 0x7fba800c7330 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fba8006d900 con 0x7fba8006e460 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba85200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fba8006dbe0 con 0x7fba800cc670 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7de00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fba8006e460 0x7fba800cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7e800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fba800c7330 0x7fba800c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:38574/0 (socket says 172.21.15.16:38574) 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7e800640 1 -- 172.21.15.16:0/809634837 learned_addr learned my addr 172.21.15.16:0/809634837 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:34.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba77e00640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba800cc670 0x7fba800c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7de00640 1 -- 172.21.15.16:0/809634837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba800cc670 msgr2=0x7fba800c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:34.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7de00640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba800cc670 0x7fba800c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7de00640 1 -- 172.21.15.16:0/809634837 >> v1:172.21.15.16:6789/0 conn(0x7fba800c7330 legacy=0x7fba800c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7de00640 1 -- 172.21.15.16:0/809634837 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8006ec50 con 0x7fba8006e460 2024-04-25T10:39:34.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.375+0000 7fba7d400640 1 -- 172.21.15.16:0/809634837 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642400020 0 0) 0x7fba780014f0 con 0x7fba800c7330 2024-04-25T10:39:34.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba7de00640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba8006e460 0x7fba800cc130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba70009900 tx=0x7fba7001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a9dad064155c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba7d400640 1 -- 172.21.15.16:0/809634837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba700b1070 con 0x7fba8006e460 2024-04-25T10:39:34.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba7d400640 1 -- 172.21.15.16:0/809634837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba700ac640 con 0x7fba8006e460 2024-04-25T10:39:34.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba7d400640 1 -- 172.21.15.16:0/809634837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba700aca10 con 0x7fba8006e460 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 -- 172.21.15.16:0/809634837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba8006e460 msgr2=0x7fba800cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba8006e460 0x7fba800cc130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba70009900 tx=0x7fba7001c510 comp rx=0 tx=0).stop 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 -- 172.21.15.16:0/809634837 shutdown_connections 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba800cc670 0x7fba800c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 --2- 172.21.15.16:0/809634837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba8006e460 0x7fba800cc130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 -- 172.21.15.16:0/809634837 >> 172.21.15.16:0/809634837 conn(0x7fba800732e0 msgr2=0x7fba800736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 -- 172.21.15.16:0/809634837 shutdown_connections 2024-04-25T10:39:34.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.379+0000 7fba85200640 1 -- 172.21.15.16:0/809634837 wait complete. 2024-04-25T10:39:34.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 Processor -- start 2024-04-25T10:39:34.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 -- start start 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 0x7fba80144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 0x7fba80150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fba801578a0 con 0x7fba800cc670 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fba80157720 con 0x7fba800c7330 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba85200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fba800c8460 con 0x7fba8006e460 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:47140/0 (socket says 172.21.15.16:47140) 2024-04-25T10:39:34.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 -- 172.21.15.16:0/2873496936 learned_addr learned my addr 172.21.15.16:0/2873496936 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba77e00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 0x7fba80150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7de00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 0x7fba80144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 -- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 msgr2=0x7fba80144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 0x7fba80144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 -- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 msgr2=0x7fba80150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 0x7fba80150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.383+0000 7fba7e800640 1 -- 172.21.15.16:0/2873496936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8015a2f0 con 0x7fba800cc670 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba7de00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 0x7fba80144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba77e00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 0x7fba80150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:34.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba7e800640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c800 tx=0x7fba7800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78018070 con 0x7fba800cc670 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7800a640 con 0x7fba800cc670 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7800aa10 con 0x7fba800cc670 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba80147b30 con 0x7fba800cc670 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8014e920 con 0x7fba800cc670 2024-04-25T10:39:34.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba801478b0 con 0x7fba800cc670 2024-04-25T10:39:34.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fba7800ac70 con 0x7fba800cc670 2024-04-25T10:39:34.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 0x7fba58071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.387+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fba7808ec90 con 0x7fba800cc670 2024-04-25T10:39:34.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.391+0000 7fba7de00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 0x7fba58071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.391+0000 7fba7de00640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 0x7fba58071ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba700ae000 tx=0x7fba70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.395+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba801478b0 con 0x7fba800cc670 2024-04-25T10:39:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.555+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fba80147d00 con 0x7fba800cc670 2024-04-25T10:39:34.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.555+0000 7fba76000640 1 -- 172.21.15.16:0/2873496936 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fba800c7740 con 0x7fba800cc670 2024-04-25T10:39:34.562 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 msgr2=0x7fba58071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 0x7fba58071ae0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba700ae000 tx=0x7fba70008040 comp rx=0 tx=0).stop 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 msgr2=0x7fba8014b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba7800c800 tx=0x7fba7800ccc0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 shutdown_connections 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fba5806f5d0 0x7fba58071ae0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba800cc670 0x7fba8014b200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba800c7330 0x7fba80150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 --2- 172.21.15.16:0/2873496936 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba8006e460 0x7fba80144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 >> 172.21.15.16:0/2873496936 conn(0x7fba800732e0 msgr2=0x7fba801528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 shutdown_connections 2024-04-25T10:39:34.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.559+0000 7fba85200640 1 -- 172.21.15.16:0/2873496936 wait complete. 2024-04-25T10:39:34.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.731+0000 7f0e47200640 1 Processor -- start 2024-04-25T10:39:34.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.731+0000 7f0e47200640 1 -- start start 2024-04-25T10:39:34.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e47200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e400c4980 0x7f0e400708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e47200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e400c9130 con 0x7f0e40070e10 2024-04-25T10:39:34.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e47200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e40071ad0 con 0x7f0e401571f0 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e47200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0e40071db0 con 0x7f0e400c4980 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e400c4980 0x7f0e400708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0e400c4980 0x7f0e400708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57382/0 (socket says 172.21.15.16:57382) 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 -- 172.21.15.16:0/3329749573 learned_addr learned my addr 172.21.15.16:0/3329749573 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e45200640 1 --1- 172.21.15.16:0/3329749573 >> v1:172.21.15.16:6789/0 conn(0x7f0e40070e10 0x7f0e40167b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57238/0 (socket says 172.21.15.16:57238) 2024-04-25T10:39:34.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 -- 172.21.15.16:0/3329749573 >> v1:172.21.15.186:6789/0 conn(0x7f0e401571f0 legacy=0x7f0e4015dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 -- 172.21.15.16:0/3329749573 >> v1:172.21.15.16:6789/0 conn(0x7f0e40070e10 legacy=0x7f0e40167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 -- 172.21.15.16:0/3329749573 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e40160950 con 0x7f0e400c4980 2024-04-25T10:39:34.741 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.735+0000 7f0e37e00640 1 --2- 172.21.15.16:0/3329749573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e400c4980 0x7f0e400708d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e40071ce0 tx=0x7f0e2801ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a75ee6dff207f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e3f400640 1 -- 172.21.15.16:0/3329749573 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b5070 con 0x7f0e400c4980 2024-04-25T10:39:34.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e3f400640 1 -- 172.21.15.16:0/3329749573 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280a8b50 con 0x7f0e400c4980 2024-04-25T10:39:34.742 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e3f400640 1 -- 172.21.15.16:0/3329749573 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b0440 con 0x7f0e400c4980 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- 172.21.15.16:0/3329749573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e400c4980 msgr2=0x7f0e400708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 --2- 172.21.15.16:0/3329749573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e400c4980 0x7f0e400708d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e40071ce0 tx=0x7f0e2801ee50 comp rx=0 tx=0).stop 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- 172.21.15.16:0/3329749573 shutdown_connections 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 --2- 172.21.15.16:0/3329749573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e400c4980 0x7f0e400708d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- 172.21.15.16:0/3329749573 >> 172.21.15.16:0/3329749573 conn(0x7f0e400cdc80 msgr2=0x7f0e400c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- 172.21.15.16:0/3329749573 shutdown_connections 2024-04-25T10:39:34.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- 172.21.15.16:0/3329749573 wait complete. 2024-04-25T10:39:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 Processor -- start 2024-04-25T10:39:34.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.739+0000 7f0e47200640 1 -- start start 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 0x7f0e401fc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e401571f0 0x7f0e40142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40157600 con 0x7f0e40070e10 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0e40160f10 con 0x7f0e400c4980 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0e400c4d90 con 0x7f0e401571f0 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57390/0 (socket says 172.21.15.16:57390) 2024-04-25T10:39:34.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 -- 172.21.15.16:0/1339559001 learned_addr learned my addr 172.21.15.16:0/1339559001 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:34.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e37e00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 0x7f0e401fc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.748 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e45200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e401571f0 0x7f0e40142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 -- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e401571f0 msgr2=0x7f0e40142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e401571f0 0x7f0e40142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 -- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 msgr2=0x7f0e401fc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 0x7f0e401fc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 -- 172.21.15.16:0/1339559001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e40152ab0 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e37e00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 0x7f0e401fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3fe00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c4e0 tx=0x7f0e3000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30016020 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e300052d0 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e40152d90 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e30007260 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e40143c50 con 0x7f0e40070e10 2024-04-25T10:39:34.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.743+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e40149610 con 0x7f0e40070e10 2024-04-25T10:39:34.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.747+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0e300074c0 con 0x7f0e40070e10 2024-04-25T10:39:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.747+0000 7f0e3cc00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 0x7f0e18071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.747+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0e3008efe0 con 0x7f0e40070e10 2024-04-25T10:39:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.747+0000 7f0e37e00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 0x7f0e18071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:34.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.747+0000 7f0e37e00640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 0x7f0e18071ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b2000 tx=0x7f0e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:34.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.751+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e30020020 con 0x7f0e40070e10 2024-04-25T10:39:34.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e4015bed0 con 0x7f0e40070e10 2024-04-25T10:39:34.959 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e3cc00640 1 -- 172.21.15.16:0/1339559001 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7f0e30005480 con 0x7f0e40070e10 2024-04-25T10:39:34.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:34.960 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T10:39:34.960 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T10:39:34.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 msgr2=0x7f0e18071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 0x7f0e18071ab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0e280b2000 tx=0x7f0e28008040 comp rx=0 tx=0).stop 2024-04-25T10:39:34.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 msgr2=0x7f0e40158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:34.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.955+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c4e0 tx=0x7f0e3000c9a0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 shutdown_connections 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0e1806f5a0 0x7f0e18071ab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0e401571f0 0x7f0e40142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e400c4980 0x7f0e401fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 --2- 172.21.15.16:0/1339559001 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e40070e10 0x7f0e40158d10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 >> 172.21.15.16:0/1339559001 conn(0x7f0e400cdc80 msgr2=0x7f0e400cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 shutdown_connections 2024-04-25T10:39:34.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:34.959+0000 7f0e47200640 1 -- 172.21.15.16:0/1339559001 wait complete. 2024-04-25T10:39:34.984 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:35.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 Processor -- start 2024-04-25T10:39:35.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 -- start start 2024-04-25T10:39:35.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa2181551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2180c7910 con 0x7fa21815eeb0 2024-04-25T10:39:35.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2180c6bc0 con 0x7fa2180cbea0 2024-04-25T10:39:35.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa21e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa2180c6e80 con 0x7fa2180c80f0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa217e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa21815eeb0 0x7fa2181658f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57248/0 (socket says 172.21.15.16:57248) 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa217e00640 1 -- 172.21.15.16:0/3819950978 learned_addr learned my addr 172.21.15.16:0/3819950978 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa217400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa2181551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552693836 0 0) 0x7fa2180c7910 con 0x7fa21815eeb0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1fc0035c0 con 0x7fa21815eeb0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012588538 0 0) 0x7fa2180c6bc0 con 0x7fa2180cbea0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2180c7910 con 0x7fa2180cbea0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 144609215 0 0) 0x7fa1fc0035c0 con 0x7fa21815eeb0 2024-04-25T10:39:35.139 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 msgr2=0x7fa2181551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.131+0000 7fa216a00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa2181551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 >> v1:172.21.15.186:6789/0 conn(0x7fa2180cbea0 legacy=0x7fa21815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2180c7630 con 0x7fa21815eeb0 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fa210001a50 con 0x7fa21815eeb0 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 >> v1:172.21.15.16:6789/0 conn(0x7fa21815eeb0 legacy=0x7fa2181658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1fc003c10 0x7fa1fc004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa1fc0048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1fc004de0 0x7fa1fc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2180c6e80 con 0x7fa1fc003c10 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc00bb40 con 0x7fa1fc004de0 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc00bd40 con 0x7fa2180c80f0 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1fc003c10 0x7fa1fc004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.140 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217e00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1fc004de0 0x7fa1fc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa20ea00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa1fc0048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 -- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 msgr2=0x7fa1fc0048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2180c80f0 0x7fa1fc0048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 -- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1fc004de0 msgr2=0x7fa1fc0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1fc004de0 0x7fa1fc0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 -- 172.21.15.16:0/3819950978 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc0035c0 con 0x7fa1fc003c10 2024-04-25T10:39:35.141 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217e00640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1fc004de0 0x7fa1fc0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:35.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.135+0000 7fa217400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1fc003c10 0x7fa1fc004020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa208009be0 tx=0x7fa20801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d7b80f098d979d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2080097b0 con 0x7fa1fc003c10 2024-04-25T10:39:35.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2080059a0 con 0x7fa1fc003c10 2024-04-25T10:39:35.142 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa216a00640 1 -- 172.21.15.16:0/3819950978 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa208005db0 con 0x7fa1fc003c10 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- 172.21.15.16:0/3819950978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1fc003c10 msgr2=0x7fa1fc004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 --2- 172.21.15.16:0/3819950978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1fc003c10 0x7fa1fc004020 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa208009be0 tx=0x7fa20801cb90 comp rx=0 tx=0).stop 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa217e00640 1 -- 172.21.15.16:0/3819950978 reap_dead start 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- 172.21.15.16:0/3819950978 shutdown_connections 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- 172.21.15.16:0/3819950978 >> 172.21.15.16:0/3819950978 conn(0x7fa218073160 msgr2=0x7fa218073650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- 172.21.15.16:0/3819950978 shutdown_connections 2024-04-25T10:39:35.143 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- 172.21.15.16:0/3819950978 wait complete. 2024-04-25T10:39:35.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 Processor -- start 2024-04-25T10:39:35.145 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.139+0000 7fa21e400640 1 -- start start 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2181582a0 0x7fa21806e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa21814f500 0x7fa21806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa2180cbb50 con 0x7fa2180b36b0 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2180cb9d0 con 0x7fa2181582a0 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa2180cc2b0 con 0x7fa21814f500 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57412/0 (socket says 172.21.15.16:57412) 2024-04-25T10:39:35.148 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 -- 172.21.15.16:0/2448631036 learned_addr learned my addr 172.21.15.16:0/2448631036 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa20ea00640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa21814f500 0x7fa21806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2181582a0 0x7fa21806e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 -- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa21814f500 msgr2=0x7fa21806ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa21814f500 0x7fa21806ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 -- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2181582a0 msgr2=0x7fa21806e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2181582a0 0x7fa21806e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 -- 172.21.15.16:0/2448631036 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa218157800 con 0x7fa2180b36b0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa217e00640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa210001fd0 tx=0x7fa21000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210007ae0 con 0x7fa2180b36b0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa210018070 con 0x7fa2180b36b0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210013620 con 0x7fa2180b36b0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2181f98d0 con 0x7fa2180b36b0 2024-04-25T10:39:35.149 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2181f9e90 con 0x7fa2180b36b0 2024-04-25T10:39:35.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.143+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa218050750 con 0x7fa2180b36b0 2024-04-25T10:39:35.150 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.147+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa210013800 con 0x7fa2180b36b0 2024-04-25T10:39:35.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.147+0000 7fa20fe00640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 0x7fa1f0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.151 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.147+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa21008fa60 con 0x7fa2180b36b0 2024-04-25T10:39:35.152 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.147+0000 7fa217400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 0x7fa1f0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.153 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.147+0000 7fa217400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 0x7fa1f0071ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ae000 tx=0x7fa2080046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.151+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa21005c650 con 0x7fa2180b36b0 2024-04-25T10:39:35.321 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.315+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2181fa4e0 con 0x7fa2180b36b0 2024-04-25T10:39:35.323 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa20fe00640 1 -- 172.21.15.16:0/2448631036 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fa21000ee20 con 0x7fa2180b36b0 2024-04-25T10:39:35.323 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:35.323 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 msgr2=0x7fa1f0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.325 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 0x7fa1f0071ab0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ae000 tx=0x7fa2080046d0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 msgr2=0x7fa2181fa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa210001fd0 tx=0x7fa21000e530 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 shutdown_connections 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa1f006f5a0 0x7fa1f0071ab0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2180b36b0 0x7fa2181fa970 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa21814f500 0x7fa21806ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 --2- 172.21.15.16:0/2448631036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2181582a0 0x7fa21806e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 >> 172.21.15.16:0/2448631036 conn(0x7fa218073160 msgr2=0x7fa2180c9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 shutdown_connections 2024-04-25T10:39:35.326 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.319+0000 7fa21e400640 1 -- 172.21.15.16:0/2448631036 wait complete. 2024-04-25T10:39:35.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:38:56.312069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:38:57.697392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:39:01.362964+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:39:35.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:39:35.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.499+0000 7ff461200640 1 Processor -- start 2024-04-25T10:39:35.505 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.499+0000 7ff461200640 1 -- start start 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff461200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff45c0c0d00 0x7ff45c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff461200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff45c155230 0x7ff45c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff461200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45c0c1260 con 0x7ff45c0c80b0 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff461200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c0c1540 con 0x7ff45c155230 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff461200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff45c0c6940 con 0x7ff45c0c0d00 2024-04-25T10:39:35.507 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff45c155230 0x7ff45c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff45c155230 0x7ff45c0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57414/0 (socket says 172.21.15.16:57414) 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 -- 172.21.15.16:0/2099435992 learned_addr learned my addr 172.21.15.16:0/2099435992 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff459e00640 1 --2- 172.21.15.16:0/2099435992 >> v2:172.21.15.186:3300/0 conn(0x7ff45c0c0d00 0x7ff45c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 -- 172.21.15.16:0/2099435992 >> v2:172.21.15.186:3300/0 conn(0x7ff45c0c0d00 msgr2=0x7ff45c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 --2- 172.21.15.16:0/2099435992 >> v2:172.21.15.186:3300/0 conn(0x7ff45c0c0d00 0x7ff45c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 -- 172.21.15.16:0/2099435992 >> v1:172.21.15.186:6789/0 conn(0x7ff45c0c80b0 legacy=0x7ff45c0c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.503+0000 7ff451400640 1 -- 172.21.15.16:0/2099435992 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c0c6c20 con 0x7ff45c155230 2024-04-25T10:39:35.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff451400640 1 --2- 172.21.15.16:0/2099435992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c155230 0x7ff45c0c7b70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff45c072290 tx=0x7ff44401c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe1313e134ebe1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff459400640 1 -- 172.21.15.16:0/2099435992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440ab640 con 0x7ff45c155230 2024-04-25T10:39:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff459400640 1 -- 172.21.15.16:0/2099435992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440b0070 con 0x7ff45c155230 2024-04-25T10:39:35.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff459400640 1 -- 172.21.15.16:0/2099435992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440aba40 con 0x7ff45c155230 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 -- 172.21.15.16:0/2099435992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c155230 msgr2=0x7ff45c0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 --2- 172.21.15.16:0/2099435992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c155230 0x7ff45c0c7b70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff45c072290 tx=0x7ff44401c640 comp rx=0 tx=0).stop 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 -- 172.21.15.16:0/2099435992 shutdown_connections 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 --2- 172.21.15.16:0/2099435992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c155230 0x7ff45c0c7b70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 --2- 172.21.15.16:0/2099435992 >> v2:172.21.15.186:3300/0 conn(0x7ff45c0c0d00 0x7ff45c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 -- 172.21.15.16:0/2099435992 >> 172.21.15.16:0/2099435992 conn(0x7ff45c074930 msgr2=0x7ff45c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 -- 172.21.15.16:0/2099435992 shutdown_connections 2024-04-25T10:39:35.512 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.507+0000 7ff461200640 1 -- 172.21.15.16:0/2099435992 wait complete. 2024-04-25T10:39:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 Processor -- start 2024-04-25T10:39:35.514 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- start start 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45c0c0d00 0x7ff45c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45c155230 0x7ff45c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1682b0 con 0x7ff45c0c80b0 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c168130 con 0x7ff45c155230 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff45c168430 con 0x7ff45c0c0d00 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57424/0 (socket says 172.21.15.16:57424) 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 -- 172.21.15.16:0/1399726756 learned_addr learned my addr 172.21.15.16:0/1399726756 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff459e00640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45c0c0d00 0x7ff45c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.516 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff45a800640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45c155230 0x7ff45c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 -- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45c0c0d00 msgr2=0x7ff45c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45c0c0d00 0x7ff45c156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 -- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45c155230 msgr2=0x7ff45c15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45c155230 0x7ff45c15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.517 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 -- 172.21.15.16:0/1399726756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1ff700 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff451400640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff444019250 tx=0x7ff44401ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440be410 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4440be5b0 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c1ff9e0 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4440be9a0 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.511+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c0c9910 con 0x7ff45c0c80b0 2024-04-25T10:39:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c1f0270 con 0x7ff45c0c80b0 2024-04-25T10:39:35.519 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff4440bc020 con 0x7ff45c0c80b0 2024-04-25T10:39:35.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff452a00640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 0x7ff434071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff4441298c0 con 0x7ff45c0c80b0 2024-04-25T10:39:35.520 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff459e00640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 0x7ff434071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.521 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.515+0000 7ff459e00640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 0x7ff434071ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007480 tx=0x7ff44c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.524 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.519+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff444016230 con 0x7ff45c0c80b0 2024-04-25T10:39:35.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff45c159b00 con 0x7ff45c0c80b0 2024-04-25T10:39:35.691 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff452a00640 1 -- 172.21.15.16:0/1399726756 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7ff4440f6390 con 0x7ff45c0c80b0 2024-04-25T10:39:35.691 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T10:39:35.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 msgr2=0x7ff434071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.693 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 0x7ff434071ae0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007480 tx=0x7ff44c00b040 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 msgr2=0x7ff45c1fbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff444019250 tx=0x7ff44401ae80 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 shutdown_connections 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff43406f5d0 0x7ff434071ae0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff45c155230 0x7ff45c15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff45c0c80b0 0x7ff45c1fbff0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 --2- 172.21.15.16:0/1399726756 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff45c0c0d00 0x7ff45c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 >> 172.21.15.16:0/1399726756 conn(0x7ff45c074930 msgr2=0x7ff45c1500a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 shutdown_connections 2024-04-25T10:39:35.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.687+0000 7ff461200640 1 -- 172.21.15.16:0/1399726756 wait complete. 2024-04-25T10:39:35.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:39:35.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.863+0000 7f7582400640 1 Processor -- start 2024-04-25T10:39:35.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.863+0000 7f7582400640 1 -- start start 2024-04-25T10:39:35.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f7582400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 0x7f757c15b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f7582400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f7582400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757c15e8b0 con 0x7f757c0cc700 2024-04-25T10:39:35.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f7582400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f757c15f430 con 0x7f757c0c67e0 2024-04-25T10:39:35.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f7582400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f757c15eb90 con 0x7f757c15bbe0 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757b400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 0x7f757c15b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757b400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 0x7f757c15b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:38318/0 (socket says 172.21.15.16:38318) 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:39296/0 (socket says 172.21.15.16:39296) 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757b400640 1 -- 172.21.15.16:0/1609059650 learned_addr learned my addr 172.21.15.16:0/1609059650 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 -- 172.21.15.16:0/1609059650 >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 msgr2=0x7f757c15b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 --2- 172.21.15.16:0/1609059650 >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 0x7f757c15b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.872 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 -- 172.21.15.16:0/1609059650 >> v1:172.21.15.186:6789/0 conn(0x7f757c0cc700 legacy=0x7f757c0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.867+0000 7f757aa00640 1 -- 172.21.15.16:0/1609059650 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c15ee70 con 0x7f757c15bbe0 2024-04-25T10:39:35.875 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f757aa00640 1 --2- 172.21.15.16:0/1609059650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7568009900 tx=0x7f756801ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c47638614a6f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f757a000640 1 -- 172.21.15.16:0/1609059650 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680b5070 con 0x7f757c15bbe0 2024-04-25T10:39:35.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f757a000640 1 -- 172.21.15.16:0/1609059650 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680a8a90 con 0x7f757c15bbe0 2024-04-25T10:39:35.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f757a000640 1 -- 172.21.15.16:0/1609059650 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680b0440 con 0x7f757c15bbe0 2024-04-25T10:39:35.876 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 -- 172.21.15.16:0/1609059650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 msgr2=0x7f757c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 --2- 172.21.15.16:0/1609059650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7568009900 tx=0x7f756801ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 -- 172.21.15.16:0/1609059650 shutdown_connections 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 --2- 172.21.15.16:0/1609059650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c15bbe0 0x7f757c0cc1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 --2- 172.21.15.16:0/1609059650 >> v2:172.21.15.186:3300/0 conn(0x7f757c0c67e0 0x7f757c15b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 -- 172.21.15.16:0/1609059650 >> 172.21.15.16:0/1609059650 conn(0x7f757c0732e0 msgr2=0x7f757c0736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 -- 172.21.15.16:0/1609059650 shutdown_connections 2024-04-25T10:39:35.877 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.871+0000 7f7582400640 1 -- 172.21.15.16:0/1609059650 wait complete. 2024-04-25T10:39:35.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 Processor -- start 2024-04-25T10:39:35.879 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 -- start start 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f757c0c67e0 0x7f757c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c0cc700 0x7f757c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f757c15e4e0 con 0x7f757c15bbe0 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f757c15b180 con 0x7f757c0c67e0 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f7582400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f757c15e660 con 0x7f757c0cc700 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57436/0 (socket says 172.21.15.16:57436) 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 -- 172.21.15.16:0/3775419610 learned_addr learned my addr 172.21.15.16:0/3775419610 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757b400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f757c0c67e0 0x7f757c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.882 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757aa00640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c0cc700 0x7f757c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 -- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c0cc700 msgr2=0x7f757c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c0cc700 0x7f757c0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 -- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f757c0c67e0 msgr2=0x7f757c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f757c0c67e0 0x7f757c0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.875+0000 7f757be00640 1 -- 172.21.15.16:0/3775419610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c14fc50 con 0x7f757c15bbe0 2024-04-25T10:39:35.883 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f757be00640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f757400c7f0 tx=0x7f757400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574016020 con 0x7f757c15bbe0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7574006d80 con 0x7f757c15bbe0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c0c6100 con 0x7f757c15bbe0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574003bc0 con 0x7f757c15bbe0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c14ab30 con 0x7f757c15bbe0 2024-04-25T10:39:35.884 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c0c6ee0 con 0x7f757c15bbe0 2024-04-25T10:39:35.885 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.879+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f757400a850 con 0x7f757c15bbe0 2024-04-25T10:39:35.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.883+0000 7f7573400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 0x7f7554071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:35.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.883+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f757408f150 con 0x7f757c15bbe0 2024-04-25T10:39:35.886 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.883+0000 7f757b400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 0x7f7554071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:35.887 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.883+0000 7f757b400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 0x7f7554071ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f756c009b50 tx=0x7f756c009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:35.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:35.887+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7574020020 con 0x7f757c15bbe0 2024-04-25T10:39:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.051+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f757c050850 con 0x7f757c15bbe0 2024-04-25T10:39:36.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.051+0000 7f7573400640 1 -- 172.21.15.16:0/3775419610 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f757405b750 con 0x7f757c15bbe0 2024-04-25T10:39:36.058 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 msgr2=0x7f7554071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 0x7f7554071ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f756c009b50 tx=0x7f756c009290 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 msgr2=0x7f757c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f757400c7f0 tx=0x7f757400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 shutdown_connections 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f755406f5a0 0x7f7554071ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f757c15bbe0 0x7f757c06d780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f757c0cc700 0x7f757c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 --2- 172.21.15.16:0/3775419610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f757c0c67e0 0x7f757c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 >> 172.21.15.16:0/3775419610 conn(0x7f757c0732e0 msgr2=0x7f757c0cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 shutdown_connections 2024-04-25T10:39:36.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.055+0000 7f7582400640 1 -- 172.21.15.16:0/3775419610 wait complete. 2024-04-25T10:39:36.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:39:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 Processor -- start 2024-04-25T10:39:36.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 -- start start 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0d480cc1c0 0x7f0d480cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4815e8b0 con 0x7f0d480c67e0 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d4815eb90 con 0x7f0d48163800 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d50000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f0d4815f430 con 0x7f0d480cc1c0 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4d600640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0d480c67e0 0x7f0d4815b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57252/0 (socket says 172.21.15.16:57252) 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4d600640 1 -- 172.21.15.16:0/3213435785 learned_addr learned my addr 172.21.15.16:0/3213435785 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:36.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0d480cc1c0 0x7f0d480cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4cc00640 1 -- 172.21.15.16:0/3213435785 >> v1:172.21.15.186:6789/0 conn(0x7f0d48163800 legacy=0x7f0d48165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d47e00640 1 -- 172.21.15.16:0/3213435785 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 449646161 0 0) 0x7f0d4815e8b0 con 0x7f0d480c67e0 2024-04-25T10:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4cc00640 1 -- 172.21.15.16:0/3213435785 >> v1:172.21.15.16:6789/0 conn(0x7f0d480c67e0 legacy=0x7f0d4815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.231+0000 7f0d4cc00640 1 -- 172.21.15.16:0/3213435785 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4815ee70 con 0x7f0d480cc1c0 2024-04-25T10:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d4cc00640 1 --2- 172.21.15.16:0/3213435785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480cc1c0 0x7f0d480cc5d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009900 tx=0x7f0d3401ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac10dc3fdd972830 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d47e00640 1 -- 172.21.15.16:0/3213435785 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340b5070 con 0x7f0d480cc1c0 2024-04-25T10:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d47e00640 1 -- 172.21.15.16:0/3213435785 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d340a8a90 con 0x7f0d480cc1c0 2024-04-25T10:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d47e00640 1 -- 172.21.15.16:0/3213435785 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340a8e60 con 0x7f0d480cc1c0 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 -- 172.21.15.16:0/3213435785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480cc1c0 msgr2=0x7f0d480cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 --2- 172.21.15.16:0/3213435785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480cc1c0 0x7f0d480cc5d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009900 tx=0x7f0d3401ed90 comp rx=0 tx=0).stop 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 -- 172.21.15.16:0/3213435785 shutdown_connections 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 --2- 172.21.15.16:0/3213435785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480cc1c0 0x7f0d480cc5d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 -- 172.21.15.16:0/3213435785 >> 172.21.15.16:0/3213435785 conn(0x7f0d480732e0 msgr2=0x7f0d480736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.235+0000 7f0d50000640 1 -- 172.21.15.16:0/3213435785 shutdown_connections 2024-04-25T10:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 -- 172.21.15.16:0/3213435785 wait complete. 2024-04-25T10:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 Processor -- start 2024-04-25T10:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 -- start start 2024-04-25T10:39:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.247 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d480cc1c0 0x7f0d4815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 0x7f0d481fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4815bdb0 con 0x7f0d480c67e0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4815b180 con 0x7f0d480cc1c0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.239+0000 7f0d50000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4815bf30 con 0x7f0d48163800 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57456/0 (socket says 172.21.15.16:57456) 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 -- 172.21.15.16:0/2361158308 learned_addr learned my addr 172.21.15.16:0/2361158308 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4cc00640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d480cc1c0 0x7f0d4815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4e000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 0x7f0d481fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 -- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 msgr2=0x7f0d481fbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 0x7f0d481fbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 -- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d480cc1c0 msgr2=0x7f0d4815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d480cc1c0 0x7f0d4815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 -- 172.21.15.16:0/2361158308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4815cda0 con 0x7f0d480c67e0 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4e000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 0x7f0d481fbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d4d600640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00c4d0 tx=0x7f0d3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c017070 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c005d30 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4806f5d0 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0072b0 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4806f010 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d480c6ee0 con 0x7f0d480c67e0 2024-04-25T10:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.243+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d3c01a070 con 0x7f0d480c67e0 2024-04-25T10:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.247+0000 7f0d45600640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 0x7f0d24071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.247+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0d3c08e940 con 0x7f0d480c67e0 2024-04-25T10:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.247+0000 7f0d4cc00640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 0x7f0d24071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.247+0000 7f0d4cc00640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 0x7f0d24071ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d340b2000 tx=0x7f0d34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.251+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d3c05aee0 con 0x7f0d480c67e0 2024-04-25T10:39:36.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.415+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0d48050750 con 0x7f0d480c67e0 2024-04-25T10:39:36.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.415+0000 7f0d45600640 1 -- 172.21.15.16:0/2361158308 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f0d3c05f1e0 con 0x7f0d480c67e0 2024-04-25T10:39:36.420 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-25T10:39:36.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 msgr2=0x7f0d24071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 0x7f0d24071ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0d340b2000 tx=0x7f0d34009040 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 msgr2=0x7f0d4815dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00c4d0 tx=0x7f0d3c00c990 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 shutdown_connections 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d2406f5a0 0x7f0d24071ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d48163800 0x7f0d481fbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d480cc1c0 0x7f0d4815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 --2- 172.21.15.16:0/2361158308 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d480c67e0 0x7f0d4815dce0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 >> 172.21.15.16:0/2361158308 conn(0x7f0d480732e0 msgr2=0x7f0d480ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 shutdown_connections 2024-04-25T10:39:36.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.419+0000 7f0d50000640 1 -- 172.21.15.16:0/2361158308 wait complete. 2024-04-25T10:39:36.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:39:36.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 Processor -- start 2024-04-25T10:39:36.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 -- start start 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4c7415eba0 0x7f4c74162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c740c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c740c8960 con 0x7f4c740c7310 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4c741625d0 con 0x7f4c7415eba0 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c79200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4c740c80c0 con 0x7f4c740c9bc0 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4c740c7310 0x7f4c740cd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57262/0 (socket says 172.21.15.16:57262) 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71e00640 1 -- 172.21.15.16:0/1763208509 learned_addr learned my addr 172.21.15.16:0/1763208509 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71400640 1 --2- 172.21.15.16:0/1763208509 >> v2:172.21.15.186:3300/0 conn(0x7f4c7415eba0 0x7f4c74162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c72800640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c740c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372518078 0 0) 0x7f4c740c8960 con 0x7f4c740c7310 2024-04-25T10:39:36.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c580035c0 con 0x7f4c740c7310 2024-04-25T10:39:36.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71400640 1 -- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 msgr2=0x7f4c740c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:36.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893507733 0 0) 0x7f4c580035c0 con 0x7f4c740c7310 2024-04-25T10:39:36.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71400640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c740c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71400640 1 -- 172.21.15.16:0/1763208509 >> v1:172.21.15.16:6789/0 conn(0x7f4c740c7310 legacy=0x7f4c740cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.595+0000 7f4c71400640 1 -- 172.21.15.16:0/1763208509 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c740c83a0 con 0x7f4c7415eba0 2024-04-25T10:39:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c71400640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74162090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009900 tx=0x7f4c6001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=697032e0e4798c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c600b5070 con 0x7f4c7415eba0 2024-04-25T10:39:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600a8730 con 0x7f4c7415eba0 2024-04-25T10:39:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c70a00640 1 -- 172.21.15.16:0/1763208509 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640016d0 con 0x7f4c7415eba0 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 -- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 msgr2=0x7f4c74162090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74162090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009900 tx=0x7f4c6001ecb0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 -- 172.21.15.16:0/1763208509 shutdown_connections 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c740c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 --2- 172.21.15.16:0/1763208509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74162090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.599+0000 7f4c79200640 1 -- 172.21.15.16:0/1763208509 >> 172.21.15.16:0/1763208509 conn(0x7f4c74074930 msgr2=0x7f4c7406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 -- 172.21.15.16:0/1763208509 shutdown_connections 2024-04-25T10:39:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 -- 172.21.15.16:0/1763208509 wait complete. 2024-04-25T10:39:36.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 Processor -- start 2024-04-25T10:39:36.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 -- start start 2024-04-25T10:39:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.603+0000 7f4c79200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c74163500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740cd440 con 0x7f4c740c7310 2024-04-25T10:39:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4c740cd160 con 0x7f4c7415eba0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7415efb0 con 0x7f4c740c9bc0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57458/0 (socket says 172.21.15.16:57458) 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 -- 172.21.15.16:0/2161092713 learned_addr learned my addr 172.21.15.16:0/2161092713 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c72800640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71400640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c74163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 -- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 msgr2=0x7f4c74163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c74163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 -- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 msgr2=0x7f4c74163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74163da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 -- 172.21.15.16:0/2161092713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741556a0 con 0x7f4c740c7310 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c71e00640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c820 tx=0x7f4c6400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64005d30 con 0x7f4c740c7310 2024-04-25T10:39:36.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6400ce10 con 0x7f4c740c7310 2024-04-25T10:39:36.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c74157b50 con 0x7f4c740c7310 2024-04-25T10:39:36.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640072b0 con 0x7f4c740c7310 2024-04-25T10:39:36.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c741fd660 con 0x7f4c740c7310 2024-04-25T10:39:36.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c74050750 con 0x7f4c740c7310 2024-04-25T10:39:36.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.607+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4c64007490 con 0x7f4c740c7310 2024-04-25T10:39:36.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.611+0000 7f4c6a000640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 0x7f4c4c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.611+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4c6408f410 con 0x7f4c740c7310 2024-04-25T10:39:36.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.611+0000 7f4c71400640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 0x7f4c4c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.611+0000 7f4c71400640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 0x7f4c4c071ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c600b2000 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.619 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.615+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c6405c000 con 0x7f4c740c7310 2024-04-25T10:39:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4c74000960 con 0x7f4c740c7310 2024-04-25T10:39:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c6a000640 1 -- 172.21.15.16:0/2161092713 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f4c6405b900 con 0x7f4c740c7310 2024-04-25T10:39:36.783 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 msgr2=0x7f4c4c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 0x7f4c4c071ab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4c600b2000 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 msgr2=0x7f4c741550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400c820 tx=0x7f4c6400cce0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 shutdown_connections 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4c4c06f5a0 0x7f4c4c071ab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c7415eba0 0x7f4c74163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c740c9bc0 0x7f4c74163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.785 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 --2- 172.21.15.16:0/2161092713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4c740c7310 0x7f4c741550e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 >> 172.21.15.16:0/2161092713 conn(0x7f4c74074930 msgr2=0x7f4c740c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 shutdown_connections 2024-04-25T10:39:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.779+0000 7f4c79200640 1 -- 172.21.15.16:0/2161092713 wait complete. 2024-04-25T10:39:36.806 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:36.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.951+0000 7ff26c400640 1 Processor -- start 2024-04-25T10:39:36.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 -- start start 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff2640c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff264162620 0x7ff264164a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2640705c0 con 0x7ff264159cb0 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff2640c41d0 con 0x7ff264162620 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26c400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff264070880 con 0x7ff2640ca730 2024-04-25T10:39:36.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff264162620 0x7ff264164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff264162620 0x7ff264164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57472/0 (socket says 172.21.15.16:57472) 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 -- 172.21.15.16:0/3847265244 learned_addr learned my addr 172.21.15.16:0/3847265244 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff269a00640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff2640c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 -- 172.21.15.16:0/3847265244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 msgr2=0x7ff2640c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff2640c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 -- 172.21.15.16:0/3847265244 >> v1:172.21.15.186:6789/0 conn(0x7ff264159cb0 legacy=0x7ff2640b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.955+0000 7ff26a400640 1 -- 172.21.15.16:0/3847265244 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264070b60 con 0x7ff264162620 2024-04-25T10:39:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26a400640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264162620 0x7ff264164a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009fa0 tx=0x7ff25c01cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462487e9f81d5630 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff263e00640 1 -- 172.21.15.16:0/3847265244 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0a5a20 con 0x7ff264162620 2024-04-25T10:39:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff263e00640 1 -- 172.21.15.16:0/3847265244 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c0a5bc0 con 0x7ff264162620 2024-04-25T10:39:36.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff263e00640 1 -- 172.21.15.16:0/3847265244 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c007430 con 0x7ff264162620 2024-04-25T10:39:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 -- 172.21.15.16:0/3847265244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264162620 msgr2=0x7ff264164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264162620 0x7ff264164a40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009fa0 tx=0x7ff25c01cb30 comp rx=0 tx=0).stop 2024-04-25T10:39:36.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 -- 172.21.15.16:0/3847265244 shutdown_connections 2024-04-25T10:39:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264162620 0x7ff264164a40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 --2- 172.21.15.16:0/3847265244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff2640c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 -- 172.21.15.16:0/3847265244 >> 172.21.15.16:0/3847265244 conn(0x7ff2640ce950 msgr2=0x7ff2640cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 -- 172.21.15.16:0/3847265244 shutdown_connections 2024-04-25T10:39:36.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.959+0000 7ff26c400640 1 -- 172.21.15.16:0/3847265244 wait complete. 2024-04-25T10:39:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 Processor -- start 2024-04-25T10:39:36.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 -- start start 2024-04-25T10:39:36.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff26414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff264162620 0x7ff264155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640b2940 con 0x7ff264159cb0 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640b27c0 con 0x7ff264162620 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26c400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff2640c3c20 con 0x7ff2640ca730 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57476/0 (socket says 172.21.15.16:57476) 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 -- 172.21.15.16:0/2041644016 learned_addr learned my addr 172.21.15.16:0/2041644016 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269a00640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff26414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff26a400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff264162620 0x7ff264155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 -- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 msgr2=0x7ff26414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff26414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 -- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff264162620 msgr2=0x7ff264155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:36.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff264162620 0x7ff264155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:36.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.963+0000 7ff269000640 1 -- 172.21.15.16:0/2041644016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264155a80 con 0x7ff264159cb0 2024-04-25T10:39:36.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff269000640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25000c480 tx=0x7ff25000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250016020 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2500052f0 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2641fbc30 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250007260 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2641fc1f0 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264050750 con 0x7ff264159cb0 2024-04-25T10:39:36.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff2500074c0 con 0x7ff264159cb0 2024-04-25T10:39:36.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 0x7ff240071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:36.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff25008ef90 con 0x7ff264159cb0 2024-04-25T10:39:36.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.967+0000 7ff269a00640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 0x7ff240071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:36.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.971+0000 7ff269a00640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 0x7ff240071ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff258009a90 tx=0x7ff258008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:36.971+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff250020020 con 0x7ff264159cb0 2024-04-25T10:39:37.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.171+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2641fb450 con 0x7ff264159cb0 2024-04-25T10:39:37.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff261600640 1 -- 172.21.15.16:0/2041644016 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7ff25005b590 con 0x7ff264159cb0 2024-04-25T10:39:37.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:37.179 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T10:39:37.179 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 msgr2=0x7ff240071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 0x7ff240071ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff258009a90 tx=0x7ff258008040 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 msgr2=0x7ff2641ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff25000c480 tx=0x7ff25000c940 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 shutdown_connections 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff24006f5a0 0x7ff240071ab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff264162620 0x7ff264155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff264159cb0 0x7ff2641ff3d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 --2- 172.21.15.16:0/2041644016 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2640ca730 0x7ff26414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 >> 172.21.15.16:0/2041644016 conn(0x7ff2640ce950 msgr2=0x7ff264151120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 shutdown_connections 2024-04-25T10:39:37.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.175+0000 7ff26c400640 1 -- 172.21.15.16:0/2041644016 wait complete. 2024-04-25T10:39:37.202 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:39:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.347+0000 7f1cf7000640 1 Processor -- start 2024-04-25T10:39:37.353 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.347+0000 7f1cf7000640 1 -- start start 2024-04-25T10:39:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf7000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf7000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 0x7f1cf015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf7000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf00c78d0 con 0x7f1cf00c80b0 2024-04-25T10:39:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf7000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf00c6b80 con 0x7f1cf00cbe60 2024-04-25T10:39:37.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf7000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00c6e40 con 0x7f1cf015e760 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1ce7e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf5000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 0x7f1cf015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1ce7e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:38358/0 (socket says 172.21.15.16:38358) 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1ce7e00640 1 -- 172.21.15.16:0/1836518925 learned_addr learned my addr 172.21.15.16:0/1836518925 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf5000640 1 -- 172.21.15.16:0/1836518925 >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 msgr2=0x7f1cf00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf5000640 1 --2- 172.21.15.16:0/1836518925 >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf5000640 1 -- 172.21.15.16:0/1836518925 >> v1:172.21.15.186:6789/0 conn(0x7f1cf00c80b0 legacy=0x7f1cf0155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1cf5000640 1 -- 172.21.15.16:0/1836518925 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf00c75f0 con 0x7f1cf015e760 2024-04-25T10:39:37.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.351+0000 7f1ce7e00640 1 --2- 172.21.15.16:0/1836518925 >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:39:37.359 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf5000640 1 --2- 172.21.15.16:0/1836518925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 0x7f1cf015eb70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009ee0 tx=0x7f1ce801ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d469d69c8f6d891c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cef400640 1 -- 172.21.15.16:0/1836518925 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80b2070 con 0x7f1cf015e760 2024-04-25T10:39:37.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cef400640 1 -- 172.21.15.16:0/1836518925 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce80a5940 con 0x7f1cf015e760 2024-04-25T10:39:37.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cef400640 1 -- 172.21.15.16:0/1836518925 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce80a5d50 con 0x7f1cf015e760 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 -- 172.21.15.16:0/1836518925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 msgr2=0x7f1cf015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1836518925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 0x7f1cf015eb70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8009ee0 tx=0x7f1ce801ca70 comp rx=0 tx=0).stop 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 -- 172.21.15.16:0/1836518925 shutdown_connections 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1836518925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e760 0x7f1cf015eb70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1836518925 >> v2:172.21.15.186:3300/0 conn(0x7f1cf00cbe60 0x7f1cf00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 -- 172.21.15.16:0/1836518925 >> 172.21.15.16:0/1836518925 conn(0x7f1cf0073130 msgr2=0x7f1cf0073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 -- 172.21.15.16:0/1836518925 shutdown_connections 2024-04-25T10:39:37.361 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.355+0000 7f1cf7000640 1 -- 172.21.15.16:0/1836518925 wait complete. 2024-04-25T10:39:37.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 Processor -- start 2024-04-25T10:39:37.363 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 -- start start 2024-04-25T10:39:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf00cbe60 0x7f1cf015de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e760 0x7f1cf006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf0168250 con 0x7f1cf00c80b0 2024-04-25T10:39:37.365 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf01680d0 con 0x7f1cf015e760 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf7000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf01683d0 con 0x7f1cf00cbe60 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57490/0 (socket says 172.21.15.16:57490) 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 -- 172.21.15.16:0/1435969659 learned_addr learned my addr 172.21.15.16:0/1435969659 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1ce7e00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf00cbe60 0x7f1cf015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cf5000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e760 0x7f1cf006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 -- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf00cbe60 msgr2=0x7f1cf015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf00cbe60 0x7f1cf015de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 -- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e760 msgr2=0x7f1cf006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e760 0x7f1cf006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 -- 172.21.15.16:0/1435969659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf015e340 con 0x7f1cf00c80b0 2024-04-25T10:39:37.366 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.359+0000 7f1cefe00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c4b0 tx=0x7f1ce000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0016020 con 0x7f1cf00c80b0 2024-04-25T10:39:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0005310 con 0x7f1cf00c80b0 2024-04-25T10:39:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0006a70 con 0x7f1cf00c80b0 2024-04-25T10:39:37.367 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf0146e50 con 0x7f1cf00c80b0 2024-04-25T10:39:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf0147b60 con 0x7f1cf00c80b0 2024-04-25T10:39:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf0050750 con 0x7f1cf00c80b0 2024-04-25T10:39:37.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ce0006cd0 con 0x7f1cf00c80b0 2024-04-25T10:39:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 0x7f1cc8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.363+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1ce008eff0 con 0x7f1cf00c80b0 2024-04-25T10:39:37.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.367+0000 7f1ce7e00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 0x7f1cc8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.367+0000 7f1ce7e00640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 0x7f1cc8071ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009680 tx=0x7f1cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.371+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ce0020020 con 0x7f1cf00c80b0 2024-04-25T10:39:37.539 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.535+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cf00c9600 con 0x7f1cf00c80b0 2024-04-25T10:39:37.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.535+0000 7f1cecc00640 1 -- 172.21.15.16:0/1435969659 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f1ce005bc20 con 0x7f1cf00c80b0 2024-04-25T10:39:37.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:37.541 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":26,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:05.370833+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 msgr2=0x7f1cc8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 0x7f1cc8071ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009680 tx=0x7f1cd8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 msgr2=0x7f1cf01fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c4b0 tx=0x7f1ce000c970 comp rx=0 tx=0).stop 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 shutdown_connections 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f1cc806f5a0 0x7f1cc8071ab0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e760 0x7f1cf006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf00cbe60 0x7f1cf015de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 --2- 172.21.15.16:0/1435969659 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf00c80b0 0x7f1cf01fbbf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 >> 172.21.15.16:0/1435969659 conn(0x7f1cf0073130 msgr2=0x7f1cf00cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:37.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 shutdown_connections 2024-04-25T10:39:37.544 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.539+0000 7f1cf7000640 1 -- 172.21.15.16:0/1435969659 wait complete. 2024-04-25T10:39:37.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:39:37.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 Processor -- start 2024-04-25T10:39:37.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 -- start start 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdec41648d0 0x7fdec4166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec40b8f60 con 0x7fdec415b9d0 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdec40b9220 con 0x7fdec40c7c40 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec9800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fdec40b9ac0 con 0x7fdec41648d0 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdeba000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdec415b9d0 0x7fdec40c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57278/0 (socket says 172.21.15.16:57278) 2024-04-25T10:39:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdeba000640 1 -- 172.21.15.16:0/866496508 learned_addr learned my addr 172.21.15.16:0/866496508 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec3400640 1 --2- 172.21.15.16:0/866496508 >> v2:172.21.15.16:3300/0 conn(0x7fdec41648d0 0x7fdec4166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec2000640 1 -- 172.21.15.16:0/866496508 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973018030 0 0) 0x7fdec40b8f60 con 0x7fdec415b9d0 2024-04-25T10:39:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.711+0000 7fdec2000640 1 -- 172.21.15.16:0/866496508 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdea80035c0 con 0x7fdec415b9d0 2024-04-25T10:39:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec3400640 1 -- 172.21.15.16:0/866496508 >> v1:172.21.15.186:6789/0 conn(0x7fdec40c7c40 legacy=0x7fdec40c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec3400640 1 -- 172.21.15.16:0/866496508 >> v1:172.21.15.16:6789/0 conn(0x7fdec415b9d0 legacy=0x7fdec40c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec3400640 1 -- 172.21.15.16:0/866496508 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec40b9500 con 0x7fdec41648d0 2024-04-25T10:39:37.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec3400640 1 --2- 172.21.15.16:0/866496508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec4166cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009ee0 tx=0x7fdebc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba87ac175874e1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec2000640 1 -- 172.21.15.16:0/866496508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b2070 con 0x7fdec41648d0 2024-04-25T10:39:37.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec2000640 1 -- 172.21.15.16:0/866496508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc0a5980 con 0x7fdec41648d0 2024-04-25T10:39:37.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.715+0000 7fdec2000640 1 -- 172.21.15.16:0/866496508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0a5d50 con 0x7fdec41648d0 2024-04-25T10:39:37.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- 172.21.15.16:0/866496508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 msgr2=0x7fdec4166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 --2- 172.21.15.16:0/866496508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec4166cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009ee0 tx=0x7fdebc01c9e0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- 172.21.15.16:0/866496508 shutdown_connections 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 --2- 172.21.15.16:0/866496508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec4166cf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- 172.21.15.16:0/866496508 >> 172.21.15.16:0/866496508 conn(0x7fdec40cdc80 msgr2=0x7fdec40c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- 172.21.15.16:0/866496508 shutdown_connections 2024-04-25T10:39:37.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- 172.21.15.16:0/866496508 wait complete. 2024-04-25T10:39:37.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 Processor -- start 2024-04-25T10:39:37.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.719+0000 7fdec9800640 1 -- start start 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdec40c7c40 0x7fdec415d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdec415b9d0 0x7fdec4166140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fdec40c82d0 con 0x7fdec41648d0 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdec40c8150 con 0x7fdec40c7c40 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdec40c7000 con 0x7fdec415b9d0 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57500/0 (socket says 172.21.15.16:57500) 2024-04-25T10:39:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 -- 172.21.15.16:0/660916635 learned_addr learned my addr 172.21.15.16:0/660916635 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdeba000640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdec415b9d0 0x7fdec4166140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec2a00640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdec40c7c40 0x7fdec415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 -- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdec415b9d0 msgr2=0x7fdec4166140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdec415b9d0 0x7fdec4166140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 -- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdec40c7c40 msgr2=0x7fdec415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdec40c7c40 0x7fdec415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 -- 172.21.15.16:0/660916635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec4166680 con 0x7fdec41648d0 2024-04-25T10:39:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec3400640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009ee0 tx=0x7fdebc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0b2050 con 0x7fdec41648d0 2024-04-25T10:39:37.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc0be070 con 0x7fdec41648d0 2024-04-25T10:39:37.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec4156e00 con 0x7fdec41648d0 2024-04-25T10:39:37.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0adab0 con 0x7fdec41648d0 2024-04-25T10:39:37.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec41570a0 con 0x7fdec41648d0 2024-04-25T10:39:37.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec4050750 con 0x7fdec41648d0 2024-04-25T10:39:37.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.723+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdebc0add10 con 0x7fdec41648d0 2024-04-25T10:39:37.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.727+0000 7fdebb400640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 0x7fde9c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:37.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.727+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdebc12a910 con 0x7fdec41648d0 2024-04-25T10:39:37.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.727+0000 7fdec2a00640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 0x7fde9c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:37.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.727+0000 7fdec2a00640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 0x7fde9c071ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40016e0 tx=0x7fdeb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.731+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdebc016660 con 0x7fdec41648d0 2024-04-25T10:39:37.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdec41573e0 con 0x7fdec41648d0 2024-04-25T10:39:37.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdebb400640 1 -- 172.21.15.16:0/660916635 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7fdec41573e0 con 0x7fdec41648d0 2024-04-25T10:39:37.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T10:39:37.943 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T10:39:37.944 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T10:39:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 msgr2=0x7fde9c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 0x7fde9c071ab0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40016e0 tx=0x7fdeb4009040 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 msgr2=0x7fdec41fb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009ee0 tx=0x7fdebc019780 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 shutdown_connections 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fde9c06f5a0 0x7fde9c071ab0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdec41648d0 0x7fdec41fb2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdec415b9d0 0x7fdec4166140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 --2- 172.21.15.16:0/660916635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdec40c7c40 0x7fdec415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 >> 172.21.15.16:0/660916635 conn(0x7fdec40cdc80 msgr2=0x7fdec4142640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 shutdown_connections 2024-04-25T10:39:37.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:37.939+0000 7fdec9800640 1 -- 172.21.15.16:0/660916635 wait complete. 2024-04-25T10:39:38.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:38:58.741400+0000', 'modified': '2024-04-25T10:39:25.793300+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4306, 'mds_1': 4294, 'mds_2': 4268}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4268': {'gid': 4268, 'name': 'b', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.186:6836/4138025047', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 4138025047}, {'type': 'v1', 'addr': '172.21.15.186:6836', 'nonce': 4138025047}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'c', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.16:6836/3989858208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6833', 'nonce': 3989858208}, {'type': 'v1', 'addr': '172.21.15.16:6836', 'nonce': 3989858208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4306': {'gid': 4306, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6839/3608237615', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 3608237615}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 3608237615}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4306, 'qdb_cluster': [4268, 4294, 4306]} 2024-04-25T10:39:38.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-25T10:39:38.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T10:39:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 Processor -- start 2024-04-25T10:39:38.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 -- start start 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f80980cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80980c78d0 con 0x7f80980c80b0 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80980c6b80 con 0x7f809815e760 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f809f000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f80980c6e40 con 0x7f80980cbe60 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8097e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f80980c80b0 0x7f8098155180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57288/0 (socket says 172.21.15.16:57288) 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8097e00640 1 -- 172.21.15.16:0/1896285205 learned_addr learned my addr 172.21.15.16:0/1896285205 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:38.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8097400640 1 --2- 172.21.15.16:0/1896285205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f80980cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892472302 0 0) 0x7f80980c78d0 con 0x7f80980c80b0 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807c0035c0 con 0x7f80980c80b0 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217374529 0 0) 0x7f80980c6b80 con 0x7f809815e760 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.727+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80980c78d0 con 0x7f809815e760 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2996938895 0 0) 0x7f807c0035c0 con 0x7f80980c80b0 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8097400640 1 -- 172.21.15.16:0/1896285205 >> v1:172.21.15.186:6789/0 conn(0x7f809815e760 legacy=0x7f809815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8097400640 1 -- 172.21.15.16:0/1896285205 >> v1:172.21.15.16:6789/0 conn(0x7f80980c80b0 legacy=0x7f8098155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8097400640 1 -- 172.21.15.16:0/1896285205 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80980c75f0 con 0x7f80980cbe60 2024-04-25T10:39:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8097400640 1 --2- 172.21.15.16:0/1896285205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f80980cc270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8084009930 tx=0x7f808401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20f096eaa2f0946 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840b0070 con 0x7f80980cbe60 2024-04-25T10:39:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80840ab400 con 0x7f80980cbe60 2024-04-25T10:39:38.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.731+0000 7f8096a00640 1 -- 172.21.15.16:0/1896285205 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088001890 con 0x7f80980cbe60 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- 172.21.15.16:0/1896285205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 msgr2=0x7f80980cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 --2- 172.21.15.16:0/1896285205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f80980cc270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8084009930 tx=0x7f808401c500 comp rx=0 tx=0).stop 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- 172.21.15.16:0/1896285205 shutdown_connections 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 --2- 172.21.15.16:0/1896285205 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f80980cc270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- 172.21.15.16:0/1896285205 >> 172.21.15.16:0/1896285205 conn(0x7f8098073130 msgr2=0x7f8098073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- 172.21.15.16:0/1896285205 shutdown_connections 2024-04-25T10:39:38.738 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- 172.21.15.16:0/1896285205 wait complete. 2024-04-25T10:39:38.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 Processor -- start 2024-04-25T10:39:38.740 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.735+0000 7f809f000640 1 -- start start 2024-04-25T10:39:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f8098144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 0x7f8098156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f8098169880 con 0x7f80980c80b0 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8098169700 con 0x7f809815e760 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8098169a00 con 0x7f80980cbe60 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57504/0 (socket says 172.21.15.16:57504) 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 -- 172.21.15.16:0/891457550 learned_addr learned my addr 172.21.15.16:0/891457550 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097400640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f8098144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809d000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 0x7f8098156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 -- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 msgr2=0x7f8098144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f8098144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 -- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 msgr2=0x7f8098156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 0x7f8098156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 -- 172.21.15.16:0/891457550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8098145200 con 0x7f80980c80b0 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809d000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 0x7f8098156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:38.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f8097e00640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f808800c870 tx=0x7f808800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f808fe00640 1 -- 172.21.15.16:0/891457550 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088017070 con 0x7f80980c80b0 2024-04-25T10:39:38.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8098157b30 con 0x7f80980c80b0 2024-04-25T10:39:38.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f808fe00640 1 -- 172.21.15.16:0/891457550 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088007480 con 0x7f80980c80b0 2024-04-25T10:39:38.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f808fe00640 1 -- 172.21.15.16:0/891457550 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088007630 con 0x7f80980c80b0 2024-04-25T10:39:38.745 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.739+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809815dfd0 con 0x7f80980c80b0 2024-04-25T10:39:38.746 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f808fe00640 1 -- 172.21.15.16:0/891457550 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f808801a070 con 0x7f80980c80b0 2024-04-25T10:39:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f808fe00640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 0x7f8070071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f808fe00640 1 -- 172.21.15.16:0/891457550 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f808808ecf0 con 0x7f80980c80b0 2024-04-25T10:39:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 Processor -- start 2024-04-25T10:39:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 -- start start 2024-04-25T10:39:38.747 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097400640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 0x7f8070071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097400640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 0x7f8070071ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad000 tx=0x7f80840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ab1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ab1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e69963160 con 0x559e69995c20 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559e698f8e20 con 0x559e69981ea0 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559e698b1a20 con 0x559e6957a280 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57512/0 (socket says 172.21.15.16:57512) 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 -- 172.21.15.16:0/1649920825 learned_addr learned my addr 172.21.15.16:0/1649920825 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f809d000640 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ab1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097400640 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ab1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 -- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 msgr2=0x559e69ab1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ab1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 -- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 msgr2=0x559e69ab1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ab1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 -- 172.21.15.16:0/1649920825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e698b6100 con 0x559e69995c20 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f8097e00640 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f80880576b0 tx=0x7f808805afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e232582825adadb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f808cc00640 1 -- 172.21.15.16:0/1649920825 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088063de0 con 0x559e69995c20 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.743+0000 7f808cc00640 1 -- 172.21.15.16:0/1649920825 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088001840 con 0x559e69995c20 2024-04-25T10:39:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f808cc00640 1 -- 172.21.15.16:0/1649920825 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088063950 con 0x559e69995c20 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- 172.21.15.16:0/1649920825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 msgr2=0x559e69ae65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f80880576b0 tx=0x7f808805afc0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- 172.21.15.16:0/1649920825 shutdown_connections 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ab1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ab1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1649920825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae65d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.752 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- 172.21.15.16:0/1649920825 >> 172.21.15.16:0/1649920825 conn(0x559e695b9ff0 msgr2=0x559e69ae9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- 172.21.15.16:0/1649920825 shutdown_connections 2024-04-25T10:39:38.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- 172.21.15.16:0/1649920825 wait complete. 2024-04-25T10:39:38.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- start start 2024-04-25T10:39:38.753 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 Processor -- start 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ae56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69995c20 0x559e69ae5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e69906220 con 0x559e6957a280 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559e6989cea0 con 0x559e69981ea0 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559e698f3b00 con 0x559e69995c20 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f80a65e8000 10 client.0 _ll_register_callbacks cb 0x559e69905dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:38.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.747+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57520/0 (socket says 172.21.15.16:57520) 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 -- 172.21.15.16:0/1476295548 learned_addr learned my addr 172.21.15.16:0/1476295548 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097400640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ae56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f809d000640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69995c20 0x559e69ae5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 -- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69995c20 msgr2=0x559e69ae5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69995c20 0x559e69ae5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 -- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 msgr2=0x559e69ae56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ae56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 -- 172.21.15.16:0/1476295548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e69898500 con 0x559e6957a280 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097e00640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f808805b050 tx=0x7f8088001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1303c2d0ebc79892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808808a060 con 0x559e6957a280 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f808805a520 con 0x559e6957a280 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8088001840 con 0x559e6957a280 2024-04-25T10:39:38.757 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f8088056a30 con 0x559e6957a280 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 10 client.4806 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x559e6987eea0 con 0x559e6957a280 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088001840 con 0x559e6957a280 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f8088059d90 con 0x559e6957a280 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 10 client.4806 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 10 client.4806 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 20 client.4806 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6959e7d0 0x559e69af5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 4 client.4806 mds_command: new command op to 4268 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 --> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e69891be0 con 0x559e6959e7d0 2024-04-25T10:39:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097400640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6959e7d0 0x559e69af5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8097400640 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6959e7d0 0x559e69af5f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=444f6319dea9fe89 server_cookie=3ffc1f0082c2521 in_seq=0 out_seq=0 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.751+0000 7f8081600640 10 client.4806 ms_handle_connect on v2:172.21.15.186:6834/4138025047 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f8081600640 1 -- 172.21.15.16:0/1476295548 <== mds.2 v2:172.21.15.186:6834/4138025047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559e69891be0 con 0x559e6959e7d0 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f8081600640 10 client.4806 handle_command_reply: tid=0 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 client.4806 shutdown 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 msgr2=0x559e69af9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f808805b050 tx=0x7f8088001370 comp rx=0 tx=0).stop 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 shutdown_connections 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69995c20 0x559e69ae5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69ae56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6959e7d0 0x559e69af5f00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1476295548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69af9390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f8081600640 0 client.4806 ms_handle_reset on v2:172.21.15.186:6834/4138025047 2024-04-25T10:39:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 >> 172.21.15.16:0/1476295548 conn(0x559e695b9ff0 msgr2=0x559e69ae67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 shutdown_connections 2024-04-25T10:39:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 1 -- 172.21.15.16:0/1476295548 wait complete. 2024-04-25T10:39:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.755+0000 7f80a65e8000 20 client.4806 trim_cache size 0 max 16384 2024-04-25T10:39:38.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 Processor -- start 2024-04-25T10:39:38.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- start start 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ae51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69b59140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f804000c920 con 0x559e69995c20 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559e6988e7d0 con 0x559e69981ea0 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559e698f8130 con 0x559e6957a280 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57522/0 (socket says 172.21.15.16:57522) 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 -- 172.21.15.16:0/1386372322 learned_addr learned my addr 172.21.15.16:0/1386372322 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8097e00640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ae51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8097400640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69b59140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 -- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 msgr2=0x559e69ae51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ae51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 -- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 msgr2=0x559e69b59140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69b59140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 -- 172.21.15.16:0/1386372322 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e69af6270 con 0x559e69995c20 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8097400640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69b59140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f809d000640 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8090003fb0 tx=0x7f80900054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0ce368321ab4cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8083e00640 1 -- 172.21.15.16:0/1386372322 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090001960 con 0x559e69995c20 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8083e00640 1 -- 172.21.15.16:0/1386372322 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090001b00 con 0x559e69995c20 2024-04-25T10:39:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f8083e00640 1 -- 172.21.15.16:0/1386372322 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090001ef0 con 0x559e69995c20 2024-04-25T10:39:38.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- 172.21.15.16:0/1386372322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 msgr2=0x559e69ae4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8090003fb0 tx=0x7f80900054e0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- 172.21.15.16:0/1386372322 shutdown_connections 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e69995c20 0x559e69ae4230 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69981ea0 0x559e69b59140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1386372322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e6957a280 0x559e69ae51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- 172.21.15.16:0/1386372322 >> 172.21.15.16:0/1386372322 conn(0x559e695b9ff0 msgr2=0x559e69aefb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- 172.21.15.16:0/1386372322 shutdown_connections 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.775+0000 7f80a65e8000 1 -- 172.21.15.16:0/1386372322 wait complete. 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 -- start start 2024-04-25T10:39:38.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 Processor -- start 2024-04-25T10:39:38.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69981ea0 0x559e69b5e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69995c20 0x559e69b6d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x559e699050c0 con 0x559e6957a280 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559e698fd450 con 0x559e69995c20 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559e69aafde0 con 0x559e69981ea0 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f80a65e8000 10 client.0 _ll_register_callbacks cb 0x7f808805a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57538/0 (socket says 172.21.15.16:57538) 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 -- 172.21.15.16:0/1675617896 learned_addr learned my addr 172.21.15.16:0/1675617896 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097400640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69981ea0 0x559e69b5e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f809d000640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69995c20 0x559e69b6d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 -- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69981ea0 msgr2=0x559e69b5e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69981ea0 0x559e69b5e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 -- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69995c20 msgr2=0x559e69b6d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69995c20 0x559e69b6d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 -- 172.21.15.16:0/1675617896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e698b1c70 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8097e00640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8088001ca0 tx=0x7f8088001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e4b674bf7c5aeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.779+0000 7f8081600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088057710 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f808805a520 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8090001b00 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f808808a030 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 10 client.4812 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x559e6997b180 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8088068080 con 0x559e6957a280 2024-04-25T10:39:38.789 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f8088082060 con 0x559e6957a280 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 10 client.4812 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 20 client.4812 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6958c830 0x559e69b6fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 4 client.4812 mds_command: new command op to 4268 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 --> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] -- command(tid 0: {"prefix": "status"}) -- 0x559e69906a30 con 0x559e6958c830 2024-04-25T10:39:38.790 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8097400640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6958c830 0x559e69b6fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.791 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8097400640 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6958c830 0x559e69b6fa70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a278c5dcc4516d7 server_cookie=900a0959c5b2214f in_seq=0 out_seq=0 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 10 client.4812 ms_handle_connect on v2:172.21.15.186:6834/4138025047 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 1 -- 172.21.15.16:0/1675617896 <== mds.2 v2:172.21.15.186:6834/4138025047 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559e69906a30 con 0x559e6958c830 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 10 client.4812 handle_command_reply: tid=0 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 client.4812 shutdown 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 msgr2=0x559e69b6c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8088001ca0 tx=0x7f8088001240 comp rx=0 tx=0).stop 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 shutdown_connections 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559e69995c20 0x559e69b6d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559e69981ea0 0x559e69b5e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.186:6834/4138025047,v1:172.21.15.186:6836/4138025047] conn(0x559e6958c830 0x559e69b6fa70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 --2- 172.21.15.16:0/1675617896 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x559e6957a280 0x559e69b6c370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f8081600640 0 client.4812 ms_handle_reset on v2:172.21.15.186:6834/4138025047 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 >> 172.21.15.16:0/1675617896 conn(0x559e695b9ff0 msgr2=0x559e69ae51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.792 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 shutdown_connections 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 1 -- 172.21.15.16:0/1675617896 wait complete. 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f80a65e8000 20 client.4812 trim_cache size 0 max 16384 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "0bf3f6ca-8da3-483e-865e-01c1c2057abb", 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 2, 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4268, 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 13.992744052000001, 2024-04-25T10:39:38.793 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 13, 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 27, 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 47.356965590000001 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 msgr2=0x7f8070071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.794 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 0x7f8070071ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad000 tx=0x7f80840a6000 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 msgr2=0x7f809814d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.783+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f808800c870 tx=0x7f808800cd30 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 shutdown_connections 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f807006f5a0 0x7f8070071ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f809815e760 0x7f8098156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f80980cbe60 0x7f8098144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 --2- 172.21.15.16:0/891457550 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80980c80b0 0x7f809814d940 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 >> 172.21.15.16:0/891457550 conn(0x7f8098073130 msgr2=0x7f8098153940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 shutdown_connections 2024-04-25T10:39:38.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.787+0000 7f809f000640 1 -- 172.21.15.16:0/891457550 wait complete. 2024-04-25T10:39:38.810 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T10:39:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 Processor -- start 2024-04-25T10:39:38.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 -- start start 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4a4815b9d0 0x7f4a480c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a480b8f60 con 0x7f4a480c97a0 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a480b9220 con 0x7f4a480c7c40 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4fc00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4a480c9bb0 con 0x7f4a4815b9d0 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4dc00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4a480c97a0 0x7f4a481658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57304/0 (socket says 172.21.15.16:57304) 2024-04-25T10:39:38.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a4dc00640 1 -- 172.21.15.16:0/1642126752 learned_addr learned my addr 172.21.15.16:0/1642126752 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1642126752 >> v2:172.21.15.186:3300/0 conn(0x7f4a4815b9d0 0x7f4a480c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828934544 0 0) 0x7f4a480b8f60 con 0x7f4a480c97a0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a2c0035c0 con 0x7f4a480c97a0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3613391127 0 0) 0x7f4a2c0035c0 con 0x7f4a480c97a0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 >> v2:172.21.15.186:3300/0 conn(0x7f4a4815b9d0 msgr2=0x7f4a480c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 --2- 172.21.15.16:0/1642126752 >> v2:172.21.15.186:3300/0 conn(0x7f4a4815b9d0 0x7f4a480c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 >> v1:172.21.15.186:6789/0 conn(0x7f4a480c7c40 legacy=0x7f4a480c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480b9500 con 0x7f4a480c97a0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f4a40001a50 con 0x7f4a480c97a0 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 >> v1:172.21.15.16:6789/0 conn(0x7f4a480c97a0 legacy=0x7f4a481658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a2c003a50 0x7f4a2c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 0x7f4a2c004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c005310 0x7f4a2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c00c220 con 0x7f4a2c0048a0 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2c00c3d0 con 0x7f4a2c005310 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.967+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2c00c5d0 con 0x7f4a2c003a50 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 0x7f4a2c004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c005310 0x7f4a2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a4d200640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a2c003a50 0x7f4a2c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 -- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a2c003a50 msgr2=0x7f4a2c003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a2c003a50 0x7f4a2c003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 -- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c005310 msgr2=0x7f4a2c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c005310 0x7f4a2c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 -- 172.21.15.16:0/1642126752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c0035c0 con 0x7f4a2c0048a0 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c005310 0x7f4a2c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:38.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a4dc00640 1 -- 172.21.15.16:0/1642126752 reap_dead start 2024-04-25T10:39:38.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 0x7f4a2c004cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009b60 tx=0x7f4a3001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d2cf9e4531380d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30009730 con 0x7f4a2c0048a0 2024-04-25T10:39:38.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a300a64e0 con 0x7f4a2c0048a0 2024-04-25T10:39:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.971+0000 7f4a47e00640 1 -- 172.21.15.16:0/1642126752 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300a68f0 con 0x7f4a2c0048a0 2024-04-25T10:39:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 msgr2=0x7f4a2c004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 0x7f4a2c004cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009b60 tx=0x7f4a3001caf0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- 172.21.15.16:0/1642126752 shutdown_connections 2024-04-25T10:39:38.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/1642126752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a2c0048a0 0x7f4a2c004cb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- 172.21.15.16:0/1642126752 >> 172.21.15.16:0/1642126752 conn(0x7f4a480cdc80 msgr2=0x7f4a480c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- 172.21.15.16:0/1642126752 shutdown_connections 2024-04-25T10:39:38.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- 172.21.15.16:0/1642126752 wait complete. 2024-04-25T10:39:38.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 Processor -- start 2024-04-25T10:39:38.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.975+0000 7f4a4fc00640 1 -- start start 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c0048a0 0x7f4a481ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a481567a0 0x7f4a481fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480c8150 con 0x7f4a481ead10 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480b9ac0 con 0x7f4a2c0048a0 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480c82d0 con 0x7f4a481567a0 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57558/0 (socket says 172.21.15.16:57558) 2024-04-25T10:39:38.983 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 -- 172.21.15.16:0/40443091 learned_addr learned my addr 172.21.15.16:0/40443091 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4d200640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c0048a0 0x7f4a481ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a481567a0 0x7f4a481fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 -- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a481567a0 msgr2=0x7f4a481fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a481567a0 0x7f4a481fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 -- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c0048a0 msgr2=0x7f4a481ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c0048a0 0x7f4a481ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 -- 172.21.15.16:0/40443091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480c46e0 con 0x7f4a481ead10 2024-04-25T10:39:38.984 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4a48144700 tx=0x7f4a4000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a45600640 1 -- 172.21.15.16:0/40443091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40007ae0 con 0x7f4a481ead10 2024-04-25T10:39:38.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a45600640 1 -- 172.21.15.16:0/40443091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a40018070 con 0x7f4a481ead10 2024-04-25T10:39:38.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a481ffd00 con 0x7f4a481ead10 2024-04-25T10:39:38.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a45600640 1 -- 172.21.15.16:0/40443091 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40013420 con 0x7f4a481ead10 2024-04-25T10:39:38.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.979+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a48156270 con 0x7f4a481ead10 2024-04-25T10:39:38.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a45600640 1 -- 172.21.15.16:0/40443091 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4a400135c0 con 0x7f4a481ead10 2024-04-25T10:39:38.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a45600640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 0x7f4a20071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a45600640 1 -- 172.21.15.16:0/40443091 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4a4008f980 con 0x7f4a481ead10 2024-04-25T10:39:38.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4d200640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 0x7f4a20071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 Processor -- start 2024-04-25T10:39:38.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 -- start start 2024-04-25T10:39:38.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4d200640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 0x7f4a20071ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a38001000 tx=0x7f4a38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e579550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a66e42b160 con 0x55a66e042280 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a66e3c0e20 con 0x55a66e45dc20 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55a66e379a20 con 0x55a66e449ea0 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4dc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57566/0 (socket says 172.21.15.16:57566) 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4dc00640 1 -- 172.21.15.16:0/3554023273 learned_addr learned my addr 172.21.15.16:0/3554023273 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a4d200640 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.983+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e579550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 -- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 msgr2=0x55a66e579550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e579550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 -- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 msgr2=0x55a66e5ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 -- 172.21.15.16:0/3554023273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66e37e100 con 0x55a66e042280 2024-04-25T10:39:38.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4a4005bd70 tx=0x7f4a4005b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba67117a1fbf894e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a3d600640 1 -- 172.21.15.16:0/3554023273 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40075290 con 0x55a66e042280 2024-04-25T10:39:38.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a3d600640 1 -- 172.21.15.16:0/3554023273 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4005bde0 con 0x55a66e042280 2024-04-25T10:39:38.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a3d600640 1 -- 172.21.15.16:0/3554023273 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a400600e0 con 0x55a66e042280 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- 172.21.15.16:0/3554023273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 msgr2=0x55a66e579a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4a4005bd70 tx=0x7f4a4005b830 comp rx=0 tx=0).stop 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- 172.21.15.16:0/3554023273 shutdown_connections 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e579a90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e579550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 --2- 172.21.15.16:0/3554023273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- 172.21.15.16:0/3554023273 >> 172.21.15.16:0/3554023273 conn(0x55a66e081ff0 msgr2=0x55a66e5b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:38.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- 172.21.15.16:0/3554023273 shutdown_connections 2024-04-25T10:39:38.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- 172.21.15.16:0/3554023273 wait complete. 2024-04-25T10:39:38.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 -- start start 2024-04-25T10:39:38.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.987+0000 7f4a5719e000 1 Processor -- start 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e5ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a66e3ce220 con 0x55a66e042280 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a66e364ea0 con 0x55a66e45dc20 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55a66e3bbb00 con 0x55a66e449ea0 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 10 client.0 _ll_register_callbacks cb 0x55a66e3cddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57572/0 (socket says 172.21.15.16:57572) 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 -- 172.21.15.16:0/2183981354 learned_addr learned my addr 172.21.15.16:0/2183981354 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e5ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:38.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 -- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 msgr2=0x55a66e5ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e5ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 -- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 msgr2=0x55a66e5adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 -- 172.21.15.16:0/2183981354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66e360500 con 0x55a66e042280 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a4d200640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a380156e0 tx=0x7f4a380011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114d66749bcd8e93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38026070 con 0x55a66e042280 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4a38014820 con 0x55a66e042280 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a4005bde0 con 0x55a66e042280 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f4a38031050 con 0x55a66e042280 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 10 client.4824 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:38.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a66e346ea0 con 0x55a66e042280 2024-04-25T10:39:38.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4005bde0 con 0x55a66e042280 2024-04-25T10:39:38.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f4a38034020 con 0x55a66e042280 2024-04-25T10:39:38.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 10 client.4824 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:38.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 10 client.4824 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 20 client.4824 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e0667d0 0x55a66e5be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 4 client.4824 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 --> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a66e359be0 con 0x55a66e0667d0 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e0667d0 0x55a66e5be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e0667d0 0x55a66e5be190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ef1832387ebb5cd server_cookie=f2459151217c3f0f in_seq=0 out_seq=0 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.991+0000 7f4a36000640 10 client.4824 ms_handle_connect on v2:172.21.15.16:6833/3989858208 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a36000640 1 -- 172.21.15.16:0/2183981354 <== mds.1 v2:172.21.15.16:6833/3989858208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a66e359be0 con 0x55a66e0667d0 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a36000640 10 client.4824 handle_command_reply: tid=0 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 client.4824 shutdown 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 msgr2=0x55a66e5c1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4a380156e0 tx=0x7f4a380011c0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 shutdown_connections 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e0667d0 0x55a66e5be190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e5adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e449ea0 0x55a66e5ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 --2- 172.21.15.16:0/2183981354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e5c1400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 >> 172.21.15.16:0/2183981354 conn(0x55a66e081ff0 msgr2=0x55a66e5ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a36000640 0 client.4824 ms_handle_reset on v2:172.21.15.16:6833/3989858208 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 shutdown_connections 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 1 -- 172.21.15.16:0/2183981354 wait complete. 2024-04-25T10:39:39.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:38.995+0000 7f4a5719e000 20 client.4824 trim_cache size 0 max 16384 2024-04-25T10:39:39.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.011+0000 7f4a5719e000 1 Processor -- start 2024-04-25T10:39:39.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.011+0000 7f4a5719e000 1 -- start start 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e042280 0x55a66e578890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e6264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f49f000c920 con 0x55a66e449ea0 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a66e3567d0 con 0x55a66e45dc20 2024-04-25T10:39:39.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55a66e3c0130 con 0x55a66e042280 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57580/0 (socket says 172.21.15.16:57580) 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 -- 172.21.15.16:0/838160633 learned_addr learned my addr 172.21.15.16:0/838160633 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a4d200640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e042280 0x55a66e578890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e6264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 -- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e042280 msgr2=0x55a66e578890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e042280 0x55a66e578890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 -- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 msgr2=0x55a66e6264a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e6264a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 -- 172.21.15.16:0/838160633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66e573130 con 0x55a66e449ea0 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e6264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a3001cb30 tx=0x7f4a300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7f325f738c1f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3cc00640 1 -- 172.21.15.16:0/838160633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300042e0 con 0x55a66e449ea0 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3cc00640 1 -- 172.21.15.16:0/838160633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30004480 con 0x55a66e449ea0 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a3cc00640 1 -- 172.21.15.16:0/838160633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a300059a0 con 0x55a66e449ea0 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- 172.21.15.16:0/838160633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 msgr2=0x55a66e625f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a3001cb30 tx=0x7f4a300046d0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- 172.21.15.16:0/838160633 shutdown_connections 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e45dc20 0x55a66e6264a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e449ea0 0x55a66e625f60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 --2- 172.21.15.16:0/838160633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e042280 0x55a66e578890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- 172.21.15.16:0/838160633 >> 172.21.15.16:0/838160633 conn(0x55a66e081ff0 msgr2=0x55a66e579560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- 172.21.15.16:0/838160633 shutdown_connections 2024-04-25T10:39:39.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.015+0000 7f4a5719e000 1 -- 172.21.15.16:0/838160633 wait complete. 2024-04-25T10:39:39.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- start start 2024-04-25T10:39:39.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 Processor -- start 2024-04-25T10:39:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e449ea0 0x55a66e62b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e45dc20 0x55a66e623550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55a66e3cd0c0 con 0x55a66e042280 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55a66e3c5450 con 0x55a66e449ea0 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55a66e5780f0 con 0x55a66e45dc20 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 10 client.0 _ll_register_callbacks cb 0x7f4a38001ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57590/0 (socket says 172.21.15.16:57590) 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 -- 172.21.15.16:0/1225533470 learned_addr learned my addr 172.21.15.16:0/1225533470 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e449ea0 0x55a66e62b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4dc00640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e45dc20 0x55a66e623550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 -- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e45dc20 msgr2=0x55a66e623550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e45dc20 0x55a66e623550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 -- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e449ea0 msgr2=0x55a66e62b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e449ea0 0x55a66e62b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 -- 172.21.15.16:0/1225533470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66e379c70 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a4d200640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a380117f0 tx=0x7f4a38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643f8901fd7b4fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38026070 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4a38021390 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a30004480 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f4a38041050 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 10 client.4830 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55a66e443180 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30004480 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.019+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7f4a38044020 con 0x55a66e042280 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 10 client.4830 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 10 client.4830 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 20 client.4830 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e054830 0x55a66e637d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 4 client.4830 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:39:39.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 --> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] -- command(tid 0: {"prefix": "status"}) -- 0x55a66e3cea30 con 0x55a66e054830 2024-04-25T10:39:39.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e054830 0x55a66e637d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a3fe00640 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e054830 0x55a66e637d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=824549811ca69375 server_cookie=a683a3ed7ef2a325 in_seq=0 out_seq=0 2024-04-25T10:39:39.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a36000640 10 client.4830 ms_handle_connect on v2:172.21.15.16:6833/3989858208 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a36000640 1 -- 172.21.15.16:0/1225533470 <== mds.1 v2:172.21.15.16:6833/3989858208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a66e3cea30 con 0x55a66e054830 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a36000640 10 client.4830 handle_command_reply: tid=0 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 client.4830 shutdown 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 msgr2=0x55a66e6245b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a380117f0 tx=0x7f4a38017000 comp rx=0 tx=0).stop 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 shutdown_connections 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55a66e45dc20 0x55a66e623550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:6833/3989858208,v1:172.21.15.16:6836/3989858208] conn(0x55a66e054830 0x55a66e637d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a66e449ea0 0x55a66e62b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 --2- 172.21.15.16:0/1225533470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55a66e042280 0x55a66e6245b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a36000640 0 client.4830 ms_handle_reset on v2:172.21.15.16:6833/3989858208 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 >> 172.21.15.16:0/1225533470 conn(0x55a66e081ff0 msgr2=0x55a66e5ad860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 shutdown_connections 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 1 -- 172.21.15.16:0/1225533470 wait complete. 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a5719e000 20 client.4830 trim_cache size 0 max 16384 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "0bf3f6ca-8da3-483e-865e-01c1c2057abb", 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 1, 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4294, 2024-04-25T10:39:39.031 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 15.240480352000001, 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 13, 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 28, 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 47.601358026 2024-04-25T10:39:39.032 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 msgr2=0x7f4a20071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 0x7f4a20071ab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4a38001000 tx=0x7f4a38009040 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 msgr2=0x7f4a481ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4a48144700 tx=0x7f4a4000e530 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 shutdown_connections 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4a2006f5a0 0x7f4a20071ab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a481ead10 0x7f4a481ff7c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4a481567a0 0x7f4a481fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 --2- 172.21.15.16:0/40443091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4a2c0048a0 0x7f4a481ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 >> 172.21.15.16:0/40443091 conn(0x7f4a480cdc80 msgr2=0x7f4a48159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 shutdown_connections 2024-04-25T10:39:39.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.023+0000 7f4a4fc00640 1 -- 172.21.15.16:0/40443091 wait complete. 2024-04-25T10:39:39.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T10:39:39.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.199+0000 7fb8df600640 1 Processor -- start 2024-04-25T10:39:39.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.199+0000 7fb8df600640 1 -- start start 2024-04-25T10:39:39.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8df600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8d80c46e0 0x7fb8d80c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8df600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb8d80c5030 0x7fb8d81647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8df600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80c5440 con 0x7fb8d8153fc0 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8df600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80c7c40 con 0x7fb8d80c46e0 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8df600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80ca9e0 con 0x7fb8d80c5030 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8cfe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8d80c46e0 0x7fb8d80c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8dcc00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb8d8153fc0 0x7fb8d80c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:57310/0 (socket says 172.21.15.16:57310) 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8dcc00640 1 -- 172.21.15.16:0/1954382336 learned_addr learned my addr 172.21.15.16:0/1954382336 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8dd600640 1 --2- 172.21.15.16:0/1954382336 >> v2:172.21.15.186:3300/0 conn(0x7fb8d80c5030 0x7fb8d81647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8cfe00640 1 -- 172.21.15.16:0/1954382336 >> v2:172.21.15.186:3300/0 conn(0x7fb8d80c5030 msgr2=0x7fb8d81647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/1954382336 >> v2:172.21.15.186:3300/0 conn(0x7fb8d80c5030 0x7fb8d81647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8cfe00640 1 -- 172.21.15.16:0/1954382336 >> v1:172.21.15.16:6789/0 conn(0x7fb8d8153fc0 legacy=0x7fb8d80c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8d7e00640 1 -- 172.21.15.16:0/1954382336 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477284335 0 0) 0x7fb8d80c5440 con 0x7fb8d8153fc0 2024-04-25T10:39:39.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.203+0000 7fb8cfe00640 1 -- 172.21.15.16:0/1954382336 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d80c7e90 con 0x7fb8d80c46e0 2024-04-25T10:39:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/1954382336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c46e0 0x7fb8d80c4af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8159e40 tx=0x7fb8c001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5052b02d080f4cff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8d7e00640 1 -- 172.21.15.16:0/1954382336 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00b2070 con 0x7fb8d80c46e0 2024-04-25T10:39:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8d7e00640 1 -- 172.21.15.16:0/1954382336 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c00ad680 con 0x7fb8d80c46e0 2024-04-25T10:39:39.211 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8d7e00640 1 -- 172.21.15.16:0/1954382336 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00ada50 con 0x7fb8d80c46e0 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 -- 172.21.15.16:0/1954382336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c46e0 msgr2=0x7fb8d80c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 --2- 172.21.15.16:0/1954382336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c46e0 0x7fb8d80c4af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8159e40 tx=0x7fb8c001c580 comp rx=0 tx=0).stop 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 -- 172.21.15.16:0/1954382336 shutdown_connections 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 --2- 172.21.15.16:0/1954382336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c46e0 0x7fb8d80c4af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 --2- 172.21.15.16:0/1954382336 >> v2:172.21.15.186:3300/0 conn(0x7fb8d80c5030 0x7fb8d81647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 -- 172.21.15.16:0/1954382336 >> 172.21.15.16:0/1954382336 conn(0x7fb8d80cdc80 msgr2=0x7fb8d80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 -- 172.21.15.16:0/1954382336 shutdown_connections 2024-04-25T10:39:39.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.207+0000 7fb8df600640 1 -- 172.21.15.16:0/1954382336 wait complete. 2024-04-25T10:39:39.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 Processor -- start 2024-04-25T10:39:39.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- start start 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8d80c46e0 0x7fb8d81fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8d8153fc0 0x7fb8d814a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d815ae60 con 0x7fb8d80c5030 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d815ace0 con 0x7fb8d8153fc0 2024-04-25T10:39:39.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d81543d0 con 0x7fb8d80c46e0 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57608/0 (socket says 172.21.15.16:57608) 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 -- 172.21.15.16:0/2902285190 learned_addr learned my addr 172.21.15.16:0/2902285190 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8d80c46e0 0x7fb8d81fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8dd600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8d8153fc0 0x7fb8d814a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 -- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8d80c46e0 msgr2=0x7fb8d81fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8d80c46e0 0x7fb8d81fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 -- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8d8153fc0 msgr2=0x7fb8d814a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8d8153fc0 0x7fb8d814a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 -- 172.21.15.16:0/2902285190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d814b5f0 con 0x7fb8d80c5030 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8c001a1b0 tx=0x7fb8c001adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8d5600640 1 -- 172.21.15.16:0/2902285190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00b2040 con 0x7fb8d80c5030 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8d5600640 1 -- 172.21.15.16:0/2902285190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c00bd070 con 0x7fb8d80c5030 2024-04-25T10:39:39.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8d5600640 1 -- 172.21.15.16:0/2902285190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0006e60 con 0x7fb8d80c5030 2024-04-25T10:39:39.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d81fd820 con 0x7fb8d80c5030 2024-04-25T10:39:39.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.211+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81f9830 con 0x7fb8d80c5030 2024-04-25T10:39:39.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8d5600640 1 -- 172.21.15.16:0/2902285190 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb8c00c2460 con 0x7fb8d80c5030 2024-04-25T10:39:39.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8d5600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 0x7fb8b0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8d5600640 1 -- 172.21.15.16:0/2902285190 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c0129a60 con 0x7fb8d80c5030 2024-04-25T10:39:39.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 0x7fb8b0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8e6bb9000 1 Processor -- start 2024-04-25T10:39:39.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8e6bb9000 1 -- start start 2024-04-25T10:39:39.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.215+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 0x7fb8b0071ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80c5610 tx=0x7fb8c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f075bea0 0x55d8f088b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f0354280 0x55d8f088ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d8f073d160 con 0x55d8f076fc20 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8f06d2e20 con 0x55d8f0354280 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55d8f068ba20 con 0x55d8f075bea0 2024-04-25T10:39:39.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57616/0 (socket says 172.21.15.16:57616) 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 -- 172.21.15.16:0/437359440 learned_addr learned my addr 172.21.15.16:0/437359440 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f075bea0 0x55d8f088b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dd600640 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f0354280 0x55d8f088ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 -- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f075bea0 msgr2=0x55d8f088b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f075bea0 0x55d8f088b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 -- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f0354280 msgr2=0x55d8f088ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f0354280 0x55d8f088ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 -- 172.21.15.16:0/437359440 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f0690100 con 0x55d8f076fc20 2024-04-25T10:39:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80058a0 tx=0x7fb8c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8157f640e672805c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8cd200640 1 -- 172.21.15.16:0/437359440 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8005e20 con 0x55d8f076fc20 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8cd200640 1 -- 172.21.15.16:0/437359440 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80070d0 con 0x55d8f076fc20 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8cd200640 1 -- 172.21.15.16:0/437359440 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8007480 con 0x55d8f076fc20 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/437359440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 msgr2=0x55d8f08c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80058a0 tx=0x7fb8c8011000 comp rx=0 tx=0).stop 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/437359440 shutdown_connections 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f0354280 0x55d8f088ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f075bea0 0x55d8f088b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/437359440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f076fc20 0x55d8f08c05d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/437359440 >> 172.21.15.16:0/437359440 conn(0x55d8f0393ff0 msgr2=0x55d8f08c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/437359440 shutdown_connections 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.219+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/437359440 wait complete. 2024-04-25T10:39:39.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- start start 2024-04-25T10:39:39.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 Processor -- start 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f08d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f076fc20 0x55d8f08cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d8f06e0220 con 0x55d8f0354280 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8f0676ea0 con 0x55d8f075bea0 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55d8f06cdb00 con 0x55d8f076fc20 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 10 client.0 _ll_register_callbacks cb 0x55d8f06dfdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57626/0 (socket says 172.21.15.16:57626) 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 -- 172.21.15.16:0/43349289 learned_addr learned my addr 172.21.15.16:0/43349289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dd600640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f076fc20 0x55d8f08cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f08d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 -- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f076fc20 msgr2=0x55d8f08cfaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f076fc20 0x55d8f08cfaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 -- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 msgr2=0x55d8f08d3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f08d3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 -- 172.21.15.16:0/43349289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f0672500 con 0x55d8f0354280 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f08d3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d8f04ecc70 tx=0x7fb8c8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65878321b149c9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8005e20 con 0x55d8f0354280 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c80047f0 con 0x55d8f0354280 2024-04-25T10:39:39.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8c80070d0 con 0x55d8f0354280 2024-04-25T10:39:39.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fb8c80049f0 con 0x55d8f0354280 2024-04-25T10:39:39.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 10 client.4845 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55d8f0658ea0 con 0x55d8f0354280 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80070d0 con 0x55d8f0354280 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7fb8c8004c10 con 0x55d8f0354280 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 10 client.4845 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 10 client.4845 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 20 client.4845 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f03787d0 0x55d8f08d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 4 client.4845 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.223+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 --> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8f066bbe0 con 0x55d8f03787d0 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f03787d0 0x55d8f08d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f03787d0 0x55d8f08d05e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f76d894b92ef2242 server_cookie=62f8c369e7eb340 in_seq=0 out_seq=0 2024-04-25T10:39:39.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8c5600640 10 client.4845 ms_handle_connect on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8c5600640 1 -- 172.21.15.16:0/43349289 <== mds.0 v2:172.21.15.186:6838/3608237615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d8f066bbe0 con 0x55d8f03787d0 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8c5600640 10 client.4845 handle_command_reply: tid=0 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 client.4845 shutdown 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 msgr2=0x55d8f08d3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55d8f04ecc70 tx=0x7fb8c8007000 comp rx=0 tx=0).stop 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 shutdown_connections 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f03787d0 0x55d8f08d05e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f076fc20 0x55d8f08cfaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f08d3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/43349289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f08d3010 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8c5600640 0 client.4845 ms_handle_reset on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:39.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 >> 172.21.15.16:0/43349289 conn(0x55d8f0393ff0 msgr2=0x55d8f08c07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 shutdown_connections 2024-04-25T10:39:39.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/43349289 wait complete. 2024-04-25T10:39:39.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.227+0000 7fb8e6bb9000 20 client.4845 trim_cache size 0 max 16384 2024-04-25T10:39:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.247+0000 7fb8e6bb9000 1 Processor -- start 2024-04-25T10:39:39.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.247+0000 7fb8e6bb9000 1 -- start start 2024-04-25T10:39:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f0354280 0x55d8f08cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f03787d0 0x55d8f0888390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb88000c870 con 0x55d8f075bea0 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8f06687d0 con 0x55d8f03787d0 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55d8f06d2130 con 0x55d8f0354280 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57636/0 (socket says 172.21.15.16:57636) 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 -- 172.21.15.16:0/1324222947 learned_addr learned my addr 172.21.15.16:0/1324222947 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f0354280 0x55d8f08cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f03787d0 0x55d8f0888390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 -- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f0354280 msgr2=0x55d8f08cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f0354280 0x55d8f08cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 -- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f03787d0 msgr2=0x55d8f0888390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.255 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f03787d0 0x55d8f0888390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.256 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 -- 172.21.15.16:0/1324222947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f088adf0 con 0x55d8f075bea0 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8dd600640 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00073f0 tx=0x7fb8d00078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6af8e7684ab9dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8c7e00640 1 -- 172.21.15.16:0/1324222947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d001b030 con 0x55d8f075bea0 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8c7e00640 1 -- 172.21.15.16:0/1324222947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d0016670 con 0x55d8f075bea0 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8c7e00640 1 -- 172.21.15.16:0/1324222947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0016a60 con 0x55d8f075bea0 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/1324222947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 msgr2=0x55d8f08ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00073f0 tx=0x7fb8d00078b0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/1324222947 shutdown_connections 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f075bea0 0x55d8f08ccd70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f03787d0 0x55d8f0888390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.257 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/1324222947 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f0354280 0x55d8f08cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/1324222947 >> 172.21.15.16:0/1324222947 conn(0x55d8f0393ff0 msgr2=0x55d8f08c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/1324222947 shutdown_connections 2024-04-25T10:39:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/1324222947 wait complete. 2024-04-25T10:39:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 -- start start 2024-04-25T10:39:39.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.251+0000 7fb8e6bb9000 1 Processor -- start 2024-04-25T10:39:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f03787d0 0x55d8f08c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f09342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x55d8f06df0c0 con 0x55d8f0354280 2024-04-25T10:39:39.261 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55d8f06d7450 con 0x55d8f075bea0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55d8f088a1f0 con 0x55d8f03787d0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 10 client.0 _ll_register_callbacks cb 0x7fb8d0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57652/0 (socket says 172.21.15.16:57652) 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 -- 172.21.15.16:0/31741456 learned_addr learned my addr 172.21.15.16:0/31741456 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f03787d0 0x55d8f08c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dd600640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f09342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 -- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f03787d0 msgr2=0x55d8f08c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f03787d0 0x55d8f08c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 -- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 msgr2=0x55d8f09342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f09342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 -- 172.21.15.16:0/31741456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f068bc70 con 0x55d8f0354280 2024-04-25T10:39:39.262 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dd600640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f09342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8dcc00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80010e0 tx=0x7fb8c8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40b99b85b064ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800ebb0 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c8029040 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8d0016670 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fb8c80047f0 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 10 client.4851 fetch_fsmap learned FSMap version 13 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55d8f0755180 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d0016670 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 13) ==== 4752+0+0 (secure 0 0 0) 0x7fb8c803e050 con 0x55d8f0354280 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 10 client.4851 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 10 client.4851 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 20 client.4851 populate_metadata read hostname 'smithi016' 2024-04-25T10:39:39.263 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f0391e80 0x55d8f094e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 4 client.4851 mds_command: new command op to 4306 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:39:39.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 --> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] -- command(tid 0: {"prefix": "status"}) -- 0x55d8f06e0a30 con 0x55d8f0391e80 2024-04-25T10:39:39.264 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.255+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f0391e80 0x55d8f094e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8cfe00640 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f0391e80 0x55d8f094e410 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbef6ce377f145f0 server_cookie=97332e7865957ef8 in_seq=0 out_seq=0 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8c5600640 10 client.4851 ms_handle_connect on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8c5600640 1 -- 172.21.15.16:0/31741456 <== mds.0 v2:172.21.15.186:6838/3608237615 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d8f06e0a30 con 0x55d8f0391e80 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8c5600640 10 client.4851 handle_command_reply: tid=0 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 client.4851 shutdown 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 msgr2=0x55d8f093d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80010e0 tx=0x7fb8c8013000 comp rx=0 tx=0).stop 2024-04-25T10:39:39.265 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 shutdown_connections 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:6838/3608237615,v1:172.21.15.186:6839/3608237615] conn(0x55d8f0391e80 0x55d8f094e410 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d8f075bea0 0x55d8f09342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55d8f03787d0 0x55d8f08c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 --2- 172.21.15.16:0/31741456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x55d8f0354280 0x55d8f093d7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8c5600640 0 client.4851 ms_handle_reset on v2:172.21.15.186:6838/3608237615 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 >> 172.21.15.16:0/31741456 conn(0x55d8f0393ff0 msgr2=0x55d8f08bc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 shutdown_connections 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 1 -- 172.21.15.16:0/31741456 wait complete. 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8e6bb9000 20 client.4851 trim_cache size 0 max 16384 2024-04-25T10:39:39.266 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "0bf3f6ca-8da3-483e-865e-01c1c2057abb", 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4306, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 39.931391759999997, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 13, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 28, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 47.829317046 2024-04-25T10:39:39.267 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 msgr2=0x7fb8b0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 0x7fb8b0071ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80c5610 tx=0x7fb8c8009040 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 msgr2=0x7fb8d815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8c001a1b0 tx=0x7fb8c001adc0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 shutdown_connections 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb8b006f5a0 0x7fb8b0071ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8d8153fc0 0x7fb8d814a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8d80c5030 0x7fb8d815f000 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 --2- 172.21.15.16:0/2902285190 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8d80c46e0 0x7fb8d81fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.268 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 >> 172.21.15.16:0/2902285190 conn(0x7fb8d80cdc80 msgr2=0x7fb8d81530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 shutdown_connections 2024-04-25T10:39:39.269 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.259+0000 7fb8df600640 1 -- 172.21.15.16:0/2902285190 wait complete. 2024-04-25T10:39:39.285 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T10:39:39.294 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T10:39:39.294 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T10:39:39.295 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T10:39:39.295 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T10:39:39.306 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T10:39:39.306 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T10:39:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:39.306 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-25T10:39:39.315 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T10:39:39.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:39.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:39:39.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:39.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-25T10:39:39.557 INFO:tasks.kclient:client.0 config is {} 2024-04-25T10:39:39.557 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:39:39.557 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:39.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:39:39.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.703+0000 7f4cdb600640 1 Processor -- start 2024-04-25T10:39:39.710 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.703+0000 7f4cdb600640 1 -- start start 2024-04-25T10:39:39.712 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd4155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4cd40c8a70 0x7f4cd40c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4cd40ca120 0x7f4cd40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd4155640 con 0x7f4cd40c8a70 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd415e5f0 con 0x7f4cd40ca120 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cdb600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd415e890 con 0x7f4cd415b960 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4cd40c8a70 0x7f4cd40c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4cd40c8a70 0x7f4cd40c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57662/0 (socket says 172.21.15.16:57662) 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2125162766 learned_addr learned my addr 172.21.15.16:0/2125162766 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd9600640 1 --2- 172.21.15.16:0/2125162766 >> v2:172.21.15.186:3300/0 conn(0x7f4cd40ca120 0x7f4cd40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd8c00640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd4155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2125162766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 msgr2=0x7f4cd4155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd4155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2125162766 >> v2:172.21.15.186:3300/0 conn(0x7f4cd40ca120 msgr2=0x7f4cd40ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:39:39.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2125162766 >> v2:172.21.15.186:3300/0 conn(0x7f4cd40ca120 0x7f4cd40ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.714 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.707+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2125162766 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd415eb70 con 0x7f4cd40c8a70 2024-04-25T10:39:39.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40c8a70 0x7f4cd40c8e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40c2ec0 tx=0x7f4cc001c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4333d378f5fb25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cd3400640 1 -- 172.21.15.16:0/2125162766 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00ab600 con 0x7f4cd40c8a70 2024-04-25T10:39:39.715 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cd3400640 1 -- 172.21.15.16:0/2125162766 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc00b0070 con 0x7f4cd40c8a70 2024-04-25T10:39:39.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cd3400640 1 -- 172.21.15.16:0/2125162766 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00aba00 con 0x7f4cd40c8a70 2024-04-25T10:39:39.716 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 -- 172.21.15.16:0/2125162766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40c8a70 msgr2=0x7f4cd40c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40c8a70 0x7f4cd40c8e80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40c2ec0 tx=0x7f4cc001c640 comp rx=0 tx=0).stop 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 -- 172.21.15.16:0/2125162766 shutdown_connections 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2125162766 >> v2:172.21.15.186:3300/0 conn(0x7f4cd40ca120 0x7f4cd40ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40c8a70 0x7f4cd40c8e80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2125162766 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd4155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 -- 172.21.15.16:0/2125162766 >> 172.21.15.16:0/2125162766 conn(0x7f4cd4073180 msgr2=0x7f4cd4073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 -- 172.21.15.16:0/2125162766 shutdown_connections 2024-04-25T10:39:39.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.711+0000 7f4cdb600640 1 -- 172.21.15.16:0/2125162766 wait complete. 2024-04-25T10:39:39.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 Processor -- start 2024-04-25T10:39:39.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 -- start start 2024-04-25T10:39:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cd40c8a70 0x7f4cd414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40c9650 con 0x7f4cd40ca120 2024-04-25T10:39:39.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd415bd70 con 0x7f4cd40c8a70 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd40c97d0 con 0x7f4cd415b960 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57666/0 (socket says 172.21.15.16:57666) 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2167041557 learned_addr learned my addr 172.21.15.16:0/2167041557 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd8c00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cd40c8a70 0x7f4cd414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd9600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 msgr2=0x7f4cd414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cd40c8a70 msgr2=0x7f4cd414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cd40c8a70 0x7f4cd414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 -- 172.21.15.16:0/2167041557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd41597c0 con 0x7f4cd40ca120 2024-04-25T10:39:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd9600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:39:39.723 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd3e00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00ad040 tx=0x7f4cc001ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00be610 con 0x7f4cd40ca120 2024-04-25T10:39:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc00be7b0 con 0x7f4cd40ca120 2024-04-25T10:39:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc00beba0 con 0x7f4cd40ca120 2024-04-25T10:39:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.715+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd415d2b0 con 0x7f4cd40ca120 2024-04-25T10:39:39.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd41fc610 con 0x7f4cd40ca120 2024-04-25T10:39:39.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd4050750 con 0x7f4cd40ca120 2024-04-25T10:39:39.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4cc00bc020 con 0x7f4cd40ca120 2024-04-25T10:39:39.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cd0c00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 0x7f4cb0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:39:39.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4cc01295c0 con 0x7f4cd40ca120 2024-04-25T10:39:39.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.719+0000 7f4cd8c00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 0x7f4cb0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:39:39.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.723+0000 7f4cd8c00640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 0x7f4cb0071ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8006fd0 tx=0x7f4cc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:39:39.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.727+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cc00c5030 con 0x7f4cd40ca120 2024-04-25T10:39:39.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.927+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4cd4070230 con 0x7f4cd40ca120 2024-04-25T10:39:39.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cd0c00640 1 -- 172.21.15.16:0/2167041557 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+88 (secure 0 0 0) 0x7f4cc0016230 con 0x7f4cd40ca120 2024-04-25T10:39:39.934 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:39:39.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 msgr2=0x7f4cb0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 0x7f4cb0071ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8006fd0 tx=0x7f4cc8008040 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 msgr2=0x7f4cd415cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00ad040 tx=0x7f4cc001ae80 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 shutdown_connections 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4cb006f5a0 0x7f4cb0071ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cd415b960 0x7f4cd414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4cd40ca120 0x7f4cd415cd70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 --2- 172.21.15.16:0/2167041557 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cd40c8a70 0x7f4cd414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 >> 172.21.15.16:0/2167041557 conn(0x7f4cd4073180 msgr2=0x7f4cd415a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 shutdown_connections 2024-04-25T10:39:39.937 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:39.931+0000 7f4cdb600640 1 -- 172.21.15.16:0/2167041557 wait complete. 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:39:39.957 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:39:39.958 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:39:39.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:39.958 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2024-04-25T10:39:39.966 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:39.967 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42427sec preferred_lft 42427sec 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:ab:6e:97:bf brd ff:ff:ff:ff:ff:ff 2024-04-25T10:39:39.968 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:39:39.969 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:39:39.969 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:39:39.970 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:40.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:40.120 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:40.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:40.127 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:39:40.192 INFO:teuthology.orchestra.run.smithi016.stdout:1 2024-04-25T10:39:40.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:40.194 DEBUG:teuthology.orchestra.run.smithi016:> route 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:39:40.251 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:39:40.252 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:40.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:40.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:40.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:40.390 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-25T10:39:40.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:40.399 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2024-04-25T10:39:40.454 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:40.454 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:40.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:39:40.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T10:39:40.454 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:40.545 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:40.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:40.582 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T10:39:40.583 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:40.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:40.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:40.729 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T10:39:40.729 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2024-04-25T10:39:40.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2024-04-25T10:39:40.729 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:39:40.729 DEBUG:teuthology.orchestra.run.smithi016:> ') 2024-04-25T10:39:40.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:40.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:40.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:39:40.815 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:40.824 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:39:40.825 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:39:40.825 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:40.873 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:39:40.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:40.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:39:40.974 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:39:40.975 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:39:41.621 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:39:41.621 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:39:41.621 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-04-25T10:39:41.621 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with new device syntax: 0@0bf3f6ca-8da3-483e-865e-01c1c2057abb.cephfs=/ 2024-04-25T10:39:41.622 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.16:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-04-25T10:39:41.626 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:39:41.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:39:41.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:41.648 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:41.756 INFO:teuthology.orchestra.run.smithi016.stdout:client4885 2024-04-25T10:39:41.756 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:39:41.756 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:39:41.766 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:39:41.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:39:41.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:41.870 INFO:teuthology.orchestra.run.smithi016.stdout:client4885 2024-04-25T10:39:41.870 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:39:41.918 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T10:39:41.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:41.931 INFO:teuthology.orchestra.run.smithi016.stdout:client4885 2024-04-25T10:39:41.931 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0bf3f6ca-8da3-483e-865e-01c1c2057abb.client4885/status') 2024-04-25T10:39:41.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T10:39:41.992 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4885 (3)172.21.15.16:0/1368861166 2024-04-25T10:39:41.993 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2024-04-25T10:39:41.993 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2024-04-25T10:39:41.993 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2024-04-25T10:39:41.993 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 5.5556e-05 s, 1.3 MB/s 2024-04-25T10:39:41.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T10:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:39:42.000 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T10:39:42.013 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:39:42.013 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T10:39:42.013 INFO:tasks.workunit:timeout=3h 2024-04-25T10:39:42.013 INFO:tasks.workunit:cleanup=True 2024-04-25T10:39:42.014 DEBUG:teuthology.orchestra.run.smithi016:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:42.022 INFO:teuthology.orchestra.run.smithi016.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:42.022 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-25T10:39:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-04-25T10:39:42.023 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:39:42.023 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T10:39:42.023 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-25 10:38:59.333462529 +0000 2024-04-25T10:39:42.023 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-25 10:39:10.891282055 +0000 2024-04-25T10:39:42.023 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-25 10:38:59.333462529 +0000 2024-04-25T10:39:42.023 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T10:39:42.023 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T10:39:42.101 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T10:39:42.155 INFO:tasks.workunit.client.0.smithi016.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T10:39:47.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:39:47.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:40:17.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:40:17.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:40:47.732 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:40:47.735 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:41:17.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:41:17.785 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:41:18.048 INFO:tasks.workunit.client.0.smithi016.stderr:Updating files: 64% (7856/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T10:41:18.591 INFO:tasks.workunit.client.0.smithi016.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T10:41:18.591 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.591 INFO:tasks.workunit.client.0.smithi016.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T10:41:18.591 INFO:tasks.workunit.client.0.smithi016.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T10:41:18.591 INFO:tasks.workunit.client.0.smithi016.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: git switch -c 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr:Or undo this operation with: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: git switch - 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr: 2024-04-25T10:41:18.592 INFO:tasks.workunit.client.0.smithi016.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T10:41:18.605 DEBUG:teuthology.orchestra.run.smithi016:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T10:41:18.654 INFO:tasks.workunit.client.0.smithi016.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T10:41:18.657 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:41:18.657 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T10:41:19.396 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T10:41:19.492 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T10:41:19.548 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T10:41:19.551 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:41:19.551 INFO:tasks.workunit.client.0.smithi016.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T10:41:19.606 INFO:tasks.workunit.client.0.smithi016.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T10:41:19.612 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T10:41:19.612 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T10:41:19.667 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-04-25T10:41:19.669 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-04-25T10:41:19.670 DEBUG:teuthology.orchestra.run.smithi016:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-04-25T10:41:19.736 INFO:tasks.workunit.client.0.smithi016.stderr:+ dbench 1 2024-04-25T10:41:19.751 INFO:tasks.workunit.client.0.smithi016.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-25T10:41:19.751 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T10:41:19.751 INFO:tasks.workunit.client.0.smithi016.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-25T10:41:19.761 INFO:tasks.workunit.client.0.smithi016.stdout:0 of 1 processes prepared for launch 0 sec 2024-04-25T10:41:19.861 INFO:tasks.workunit.client.0.smithi016.stdout:1 of 1 processes prepared for launch 0 sec 2024-04-25T10:41:19.861 INFO:tasks.workunit.client.0.smithi016.stdout:releasing clients 2024-04-25T10:41:20.861 INFO:tasks.workunit.client.0.smithi016.stdout: 1 1084 22.93 MB/sec warmup 1 sec latency 12.566 ms 2024-04-25T10:41:21.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 3015 16.77 MB/sec warmup 2 sec latency 15.480 ms 2024-04-25T10:41:22.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 4107 13.36 MB/sec warmup 3 sec latency 20.239 ms 2024-04-25T10:41:23.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 5700 11.45 MB/sec warmup 4 sec latency 36.071 ms 2024-04-25T10:41:24.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 7336 11.78 MB/sec warmup 5 sec latency 12.814 ms 2024-04-25T10:41:25.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 8091 10.02 MB/sec warmup 6 sec latency 41.197 ms 2024-04-25T10:41:26.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 9978 10.06 MB/sec warmup 7 sec latency 15.665 ms 2024-04-25T10:41:27.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 11081 9.79 MB/sec warmup 8 sec latency 15.085 ms 2024-04-25T10:41:28.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 12341 9.29 MB/sec warmup 9 sec latency 28.188 ms 2024-04-25T10:41:29.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 14280 9.60 MB/sec warmup 10 sec latency 35.605 ms 2024-04-25T10:41:30.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 15022 8.91 MB/sec warmup 11 sec latency 22.906 ms 2024-04-25T10:41:31.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 16771 8.79 MB/sec warmup 12 sec latency 16.793 ms 2024-04-25T10:41:32.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18051 8.94 MB/sec warmup 13 sec latency 16.176 ms 2024-04-25T10:41:33.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 18836 8.47 MB/sec warmup 14 sec latency 35.526 ms 2024-04-25T10:41:34.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 20792 8.61 MB/sec warmup 15 sec latency 27.906 ms 2024-04-25T10:41:35.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 21918 8.48 MB/sec warmup 16 sec latency 15.860 ms 2024-04-25T10:41:36.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 23303 8.31 MB/sec warmup 17 sec latency 33.200 ms 2024-04-25T10:41:37.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 24993 8.53 MB/sec warmup 18 sec latency 15.683 ms 2024-04-25T10:41:38.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 25680 8.18 MB/sec warmup 19 sec latency 69.696 ms 2024-04-25T10:41:39.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 27631 8.29 MB/sec warmup 20 sec latency 32.765 ms 2024-04-25T10:41:40.862 INFO:tasks.workunit.client.0.smithi016.stdout: 1 28836 8.28 MB/sec warmup 21 sec latency 15.559 ms 2024-04-25T10:41:41.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 29936 8.14 MB/sec warmup 22 sec latency 26.182 ms 2024-04-25T10:41:42.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 31712 8.19 MB/sec warmup 23 sec latency 13.974 ms 2024-04-25T10:41:43.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 32643 8.05 MB/sec warmup 24 sec latency 29.507 ms 2024-04-25T10:41:44.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 34526 8.04 MB/sec warmup 25 sec latency 13.779 ms 2024-04-25T10:41:45.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 35893 8.16 MB/sec warmup 26 sec latency 14.931 ms 2024-04-25T10:41:46.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 37066 8.05 MB/sec warmup 27 sec latency 29.628 ms 2024-04-25T10:41:47.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 38869 8.10 MB/sec warmup 28 sec latency 13.289 ms 2024-04-25T10:41:47.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:41:47.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:41:48.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 39722 7.98 MB/sec warmup 29 sec latency 33.561 ms 2024-04-25T10:41:49.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 41447 7.94 MB/sec warmup 30 sec latency 45.064 ms 2024-04-25T10:41:50.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 42939 8.08 MB/sec warmup 31 sec latency 87.010 ms 2024-04-25T10:41:51.863 INFO:tasks.workunit.client.0.smithi016.stdout: 1 44314 7.99 MB/sec warmup 32 sec latency 32.153 ms 2024-04-25T10:41:52.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 46262 8.13 MB/sec warmup 33 sec latency 15.314 ms 2024-04-25T10:41:53.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 46928 7.94 MB/sec warmup 34 sec latency 37.571 ms 2024-04-25T10:41:54.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 48644 7.92 MB/sec warmup 35 sec latency 27.783 ms 2024-04-25T10:41:55.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 49983 8.01 MB/sec warmup 36 sec latency 18.080 ms 2024-04-25T10:41:56.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 50747 7.85 MB/sec warmup 37 sec latency 39.873 ms 2024-04-25T10:41:57.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 52699 7.93 MB/sec warmup 38 sec latency 14.344 ms 2024-04-25T10:41:58.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 53653 7.89 MB/sec warmup 39 sec latency 35.883 ms 2024-04-25T10:41:59.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 54795 7.82 MB/sec warmup 40 sec latency 23.274 ms 2024-04-25T10:42:00.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 56599 7.86 MB/sec warmup 41 sec latency 15.455 ms 2024-04-25T10:42:01.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 57321 7.78 MB/sec warmup 42 sec latency 128.441 ms 2024-04-25T10:42:02.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 58695 7.73 MB/sec warmup 43 sec latency 33.503 ms 2024-04-25T10:42:03.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 60333 7.83 MB/sec warmup 44 sec latency 26.458 ms 2024-04-25T10:42:04.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 60995 7.69 MB/sec warmup 45 sec latency 35.570 ms 2024-04-25T10:42:05.864 INFO:tasks.workunit.client.0.smithi016.stdout: 1 62925 7.70 MB/sec warmup 46 sec latency 40.914 ms 2024-04-25T10:42:06.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 64241 7.77 MB/sec warmup 47 sec latency 79.906 ms 2024-04-25T10:42:07.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 65933 7.73 MB/sec warmup 48 sec latency 38.253 ms 2024-04-25T10:42:08.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 67537 7.81 MB/sec warmup 49 sec latency 18.639 ms 2024-04-25T10:42:09.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 68206 7.69 MB/sec warmup 50 sec latency 36.975 ms 2024-04-25T10:42:10.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 69978 7.69 MB/sec warmup 51 sec latency 28.449 ms 2024-04-25T10:42:11.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 71371 7.76 MB/sec warmup 52 sec latency 94.593 ms 2024-04-25T10:42:12.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 73197 7.72 MB/sec warmup 53 sec latency 26.978 ms 2024-04-25T10:42:13.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 74651 7.80 MB/sec warmup 54 sec latency 66.972 ms 2024-04-25T10:42:14.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 75353 7.69 MB/sec warmup 55 sec latency 36.142 ms 2024-04-25T10:42:15.865 INFO:tasks.workunit.client.0.smithi016.stdout: 1 77139 7.69 MB/sec warmup 56 sec latency 20.632 ms 2024-04-25T10:42:16.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 78362 7.74 MB/sec warmup 57 sec latency 60.563 ms 2024-04-25T10:42:17.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 79496 7.70 MB/sec warmup 58 sec latency 44.579 ms 2024-04-25T10:42:17.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:42:17.957 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:42:18.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 81095 7.70 MB/sec warmup 59 sec latency 112.730 ms 2024-04-25T10:42:19.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 82202 7.68 MB/sec warmup 60 sec latency 13.330 ms 2024-04-25T10:42:20.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 83615 7.64 MB/sec warmup 61 sec latency 34.974 ms 2024-04-25T10:42:21.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 85251 7.72 MB/sec warmup 62 sec latency 65.282 ms 2024-04-25T10:42:22.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 86155 7.63 MB/sec warmup 63 sec latency 28.438 ms 2024-04-25T10:42:23.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 88190 7.70 MB/sec warmup 64 sec latency 15.888 ms 2024-04-25T10:42:24.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 89179 7.68 MB/sec warmup 65 sec latency 25.317 ms 2024-04-25T10:42:25.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 90394 7.64 MB/sec warmup 66 sec latency 34.926 ms 2024-04-25T10:42:26.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 92262 7.71 MB/sec warmup 67 sec latency 125.615 ms 2024-04-25T10:42:27.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 93182 7.63 MB/sec warmup 68 sec latency 28.251 ms 2024-04-25T10:42:28.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 95029 7.67 MB/sec warmup 69 sec latency 25.135 ms 2024-04-25T10:42:29.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 96158 7.68 MB/sec warmup 70 sec latency 15.001 ms 2024-04-25T10:42:30.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 96924 7.60 MB/sec warmup 71 sec latency 37.492 ms 2024-04-25T10:42:31.866 INFO:tasks.workunit.client.0.smithi016.stdout: 1 98717 7.63 MB/sec warmup 72 sec latency 78.978 ms 2024-04-25T10:42:32.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 99967 7.62 MB/sec warmup 73 sec latency 13.004 ms 2024-04-25T10:42:33.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 101778 7.62 MB/sec warmup 74 sec latency 53.142 ms 2024-04-25T10:42:34.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 103128 7.67 MB/sec warmup 75 sec latency 15.230 ms 2024-04-25T10:42:35.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 103699 7.58 MB/sec warmup 76 sec latency 53.528 ms 2024-04-25T10:42:36.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 105328 7.57 MB/sec warmup 77 sec latency 84.392 ms 2024-04-25T10:42:37.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 106574 7.61 MB/sec warmup 78 sec latency 87.359 ms 2024-04-25T10:42:38.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 107440 7.54 MB/sec warmup 79 sec latency 31.368 ms 2024-04-25T10:42:39.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 109619 7.60 MB/sec warmup 80 sec latency 30.689 ms 2024-04-25T10:42:40.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 110404 7.58 MB/sec warmup 81 sec latency 26.217 ms 2024-04-25T10:42:41.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 111594 7.55 MB/sec warmup 82 sec latency 40.624 ms 2024-04-25T10:42:42.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 113367 7.57 MB/sec warmup 83 sec latency 64.463 ms 2024-04-25T10:42:43.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 114261 7.54 MB/sec warmup 84 sec latency 36.534 ms 2024-04-25T10:42:44.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 116022 7.54 MB/sec warmup 85 sec latency 28.065 ms 2024-04-25T10:42:45.867 INFO:tasks.workunit.client.0.smithi016.stdout: 1 117331 7.58 MB/sec warmup 86 sec latency 19.596 ms 2024-04-25T10:42:46.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 118139 7.52 MB/sec warmup 87 sec latency 37.883 ms 2024-04-25T10:42:47.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 119876 7.53 MB/sec warmup 88 sec latency 61.407 ms 2024-04-25T10:42:48.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:42:48.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:42:48.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 121021 7.54 MB/sec warmup 89 sec latency 43.062 ms 2024-04-25T10:42:49.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 122058 7.51 MB/sec warmup 90 sec latency 25.423 ms 2024-04-25T10:42:50.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 124168 7.57 MB/sec warmup 91 sec latency 32.107 ms 2024-04-25T10:42:51.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 124802 7.50 MB/sec warmup 92 sec latency 15.031 ms 2024-04-25T10:42:52.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 126102 7.48 MB/sec warmup 93 sec latency 60.640 ms 2024-04-25T10:42:53.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 127846 7.53 MB/sec warmup 94 sec latency 43.146 ms 2024-04-25T10:42:54.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 128528 7.47 MB/sec warmup 95 sec latency 22.419 ms 2024-04-25T10:42:55.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 130280 7.47 MB/sec warmup 96 sec latency 29.858 ms 2024-04-25T10:42:56.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 131553 7.51 MB/sec warmup 97 sec latency 14.144 ms 2024-04-25T10:42:57.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 132296 7.45 MB/sec warmup 98 sec latency 96.563 ms 2024-04-25T10:42:58.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 134445 7.49 MB/sec warmup 99 sec latency 31.155 ms 2024-04-25T10:42:59.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 135260 7.48 MB/sec warmup 100 sec latency 15.894 ms 2024-04-25T10:43:00.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 136339 7.45 MB/sec warmup 101 sec latency 38.105 ms 2024-04-25T10:43:01.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 138170 7.47 MB/sec warmup 102 sec latency 36.971 ms 2024-04-25T10:43:02.868 INFO:tasks.workunit.client.0.smithi016.stdout: 1 138811 7.44 MB/sec warmup 103 sec latency 103.473 ms 2024-04-25T10:43:03.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 140053 7.42 MB/sec warmup 104 sec latency 37.845 ms 2024-04-25T10:43:04.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 141944 7.47 MB/sec warmup 105 sec latency 31.375 ms 2024-04-25T10:43:05.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 142633 7.42 MB/sec warmup 106 sec latency 33.667 ms 2024-04-25T10:43:06.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 144359 7.41 MB/sec warmup 107 sec latency 16.837 ms 2024-04-25T10:43:07.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 145734 7.45 MB/sec warmup 108 sec latency 65.893 ms 2024-04-25T10:43:08.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 146931 7.43 MB/sec warmup 109 sec latency 32.999 ms 2024-04-25T10:43:09.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 148834 7.45 MB/sec warmup 110 sec latency 33.729 ms 2024-04-25T10:43:10.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 149598 7.42 MB/sec warmup 111 sec latency 13.764 ms 2024-04-25T10:43:11.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 151094 7.41 MB/sec warmup 112 sec latency 32.178 ms 2024-04-25T10:43:12.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 152513 7.45 MB/sec warmup 113 sec latency 68.732 ms 2024-04-25T10:43:13.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 153272 7.40 MB/sec warmup 114 sec latency 39.405 ms 2024-04-25T10:43:14.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 154939 7.39 MB/sec warmup 115 sec latency 30.828 ms 2024-04-25T10:43:15.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 156251 7.42 MB/sec warmup 116 sec latency 16.347 ms 2024-04-25T10:43:16.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 156873 7.37 MB/sec warmup 117 sec latency 37.135 ms 2024-04-25T10:43:17.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 158517 7.37 MB/sec warmup 118 sec latency 56.371 ms 2024-04-25T10:43:18.712 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:43:18.716 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:43:18.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 159941 7.40 MB/sec warmup 119 sec latency 21.138 ms 2024-04-25T10:43:20.869 INFO:tasks.workunit.client.0.smithi016.stdout: 1 162621 10.46 MB/sec execute 1 sec latency 37.276 ms 2024-04-25T10:43:21.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 163578 8.50 MB/sec execute 2 sec latency 14.949 ms 2024-04-25T10:43:22.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 164679 7.37 MB/sec execute 3 sec latency 26.468 ms 2024-04-25T10:43:23.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 166558 7.88 MB/sec execute 4 sec latency 88.259 ms 2024-04-25T10:43:24.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 167268 7.23 MB/sec execute 5 sec latency 14.943 ms 2024-04-25T10:43:25.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 168437 6.90 MB/sec execute 6 sec latency 41.120 ms 2024-04-25T10:43:26.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 170282 7.66 MB/sec execute 7 sec latency 16.716 ms 2024-04-25T10:43:27.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 170969 6.93 MB/sec execute 8 sec latency 37.633 ms 2024-04-25T10:43:28.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 172663 6.92 MB/sec execute 9 sec latency 63.971 ms 2024-04-25T10:43:29.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 174031 7.41 MB/sec execute 10 sec latency 29.579 ms 2024-04-25T10:43:30.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 174735 6.83 MB/sec execute 11 sec latency 27.959 ms 2024-04-25T10:43:31.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 176313 6.84 MB/sec execute 12 sec latency 28.325 ms 2024-04-25T10:43:32.870 INFO:tasks.workunit.client.0.smithi016.stdout: 1 177634 7.17 MB/sec execute 13 sec latency 15.686 ms 2024-04-25T10:43:33.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 178278 6.73 MB/sec execute 14 sec latency 83.228 ms 2024-04-25T10:43:34.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 180142 6.97 MB/sec execute 15 sec latency 56.312 ms 2024-04-25T10:43:35.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 181281 7.04 MB/sec execute 16 sec latency 23.899 ms 2024-04-25T10:43:36.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 182172 6.75 MB/sec execute 17 sec latency 49.533 ms 2024-04-25T10:43:37.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 183911 6.95 MB/sec execute 18 sec latency 29.548 ms 2024-04-25T10:43:38.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 184882 6.93 MB/sec execute 19 sec latency 71.433 ms 2024-04-25T10:43:39.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 186096 6.85 MB/sec execute 20 sec latency 33.638 ms 2024-04-25T10:43:40.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 187806 6.96 MB/sec execute 21 sec latency 14.874 ms 2024-04-25T10:43:41.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 188460 6.86 MB/sec execute 22 sec latency 20.962 ms 2024-04-25T10:43:42.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 189525 6.78 MB/sec execute 23 sec latency 177.139 ms 2024-04-25T10:43:43.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 191511 7.01 MB/sec execute 24 sec latency 70.677 ms 2024-04-25T10:43:44.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 192213 6.80 MB/sec execute 25 sec latency 39.042 ms 2024-04-25T10:43:45.871 INFO:tasks.workunit.client.0.smithi016.stdout: 1 193925 6.81 MB/sec execute 26 sec latency 39.976 ms 2024-04-25T10:43:46.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 195304 6.99 MB/sec execute 27 sec latency 13.327 ms 2024-04-25T10:43:47.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 196077 6.78 MB/sec execute 28 sec latency 40.541 ms 2024-04-25T10:43:48.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:43:48.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:43:48.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 197872 6.90 MB/sec execute 29 sec latency 42.713 ms 2024-04-25T10:43:49.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 199109 6.94 MB/sec execute 30 sec latency 19.343 ms 2024-04-25T10:43:50.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 200415 6.89 MB/sec execute 31 sec latency 31.722 ms 2024-04-25T10:43:51.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 202151 7.05 MB/sec execute 32 sec latency 17.637 ms 2024-04-25T10:43:52.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 202805 6.89 MB/sec execute 33 sec latency 34.390 ms 2024-04-25T10:43:53.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 203965 6.84 MB/sec execute 34 sec latency 98.701 ms 2024-04-25T10:43:54.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 205871 7.00 MB/sec execute 35 sec latency 33.487 ms 2024-04-25T10:43:55.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 206451 6.85 MB/sec execute 36 sec latency 36.549 ms 2024-04-25T10:43:56.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 208064 6.85 MB/sec execute 37 sec latency 29.563 ms 2024-04-25T10:43:57.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 209383 6.95 MB/sec execute 38 sec latency 16.508 ms 2024-04-25T10:43:58.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 209945 6.81 MB/sec execute 39 sec latency 41.007 ms 2024-04-25T10:43:59.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 211680 6.81 MB/sec execute 40 sec latency 29.780 ms 2024-04-25T10:44:00.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 213030 6.94 MB/sec execute 41 sec latency 14.815 ms 2024-04-25T10:44:01.872 INFO:tasks.workunit.client.0.smithi016.stdout: 1 213641 6.79 MB/sec execute 42 sec latency 35.222 ms 2024-04-25T10:44:02.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 215342 6.80 MB/sec execute 43 sec latency 30.314 ms 2024-04-25T10:44:03.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 216655 6.90 MB/sec execute 44 sec latency 33.466 ms 2024-04-25T10:44:04.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 217367 6.77 MB/sec execute 45 sec latency 76.979 ms 2024-04-25T10:44:05.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 219300 6.85 MB/sec execute 46 sec latency 18.705 ms 2024-04-25T10:44:06.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 220340 6.87 MB/sec execute 47 sec latency 18.952 ms 2024-04-25T10:44:07.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 221400 6.83 MB/sec execute 48 sec latency 44.377 ms 2024-04-25T10:44:08.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 222977 6.85 MB/sec execute 49 sec latency 44.861 ms 2024-04-25T10:44:09.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 224048 6.84 MB/sec execute 50 sec latency 83.494 ms 2024-04-25T10:44:10.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 225324 6.81 MB/sec execute 51 sec latency 36.214 ms 2024-04-25T10:44:11.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 227054 6.91 MB/sec execute 52 sec latency 17.966 ms 2024-04-25T10:44:12.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 227651 6.82 MB/sec execute 53 sec latency 22.068 ms 2024-04-25T10:44:13.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 229402 6.82 MB/sec execute 54 sec latency 27.774 ms 2024-04-25T10:44:14.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 230751 6.89 MB/sec execute 55 sec latency 98.071 ms 2024-04-25T10:44:15.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 231414 6.80 MB/sec execute 56 sec latency 24.668 ms 2024-04-25T10:44:16.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 233481 6.87 MB/sec execute 57 sec latency 38.824 ms 2024-04-25T10:44:17.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 234455 6.88 MB/sec execute 58 sec latency 17.944 ms 2024-04-25T10:44:18.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:44:18.844 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:44:18.873 INFO:tasks.workunit.client.0.smithi016.stdout: 1 235302 6.81 MB/sec execute 59 sec latency 43.611 ms 2024-04-25T10:44:19.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 236755 6.79 MB/sec execute 60 sec latency 118.091 ms 2024-04-25T10:44:20.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 237953 6.86 MB/sec execute 61 sec latency 20.236 ms 2024-04-25T10:44:21.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 238686 6.77 MB/sec execute 62 sec latency 26.593 ms 2024-04-25T10:44:22.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 240291 6.77 MB/sec execute 63 sec latency 27.756 ms 2024-04-25T10:44:23.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 241524 6.83 MB/sec execute 64 sec latency 16.156 ms 2024-04-25T10:44:24.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 242283 6.76 MB/sec execute 65 sec latency 40.199 ms 2024-04-25T10:44:25.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 244229 6.82 MB/sec execute 66 sec latency 27.754 ms 2024-04-25T10:44:26.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 245202 6.82 MB/sec execute 67 sec latency 14.605 ms 2024-04-25T10:44:27.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 246445 6.80 MB/sec execute 68 sec latency 36.108 ms 2024-04-25T10:44:28.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 248343 6.87 MB/sec execute 69 sec latency 11.105 ms 2024-04-25T10:44:29.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 249013 6.80 MB/sec execute 70 sec latency 92.132 ms 2024-04-25T10:44:30.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 250730 6.80 MB/sec execute 71 sec latency 25.157 ms 2024-04-25T10:44:31.874 INFO:tasks.workunit.client.0.smithi016.stdout: 1 252115 6.87 MB/sec execute 72 sec latency 20.962 ms 2024-04-25T10:44:32.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 252803 6.79 MB/sec execute 73 sec latency 37.906 ms 2024-04-25T10:44:33.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 254636 6.84 MB/sec execute 74 sec latency 28.663 ms 2024-04-25T10:44:34.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 255731 6.85 MB/sec execute 75 sec latency 83.178 ms 2024-04-25T10:44:35.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 256607 6.79 MB/sec execute 76 sec latency 28.964 ms 2024-04-25T10:44:36.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 258397 6.84 MB/sec execute 77 sec latency 49.665 ms 2024-04-25T10:44:37.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 259338 6.84 MB/sec execute 78 sec latency 16.380 ms 2024-04-25T10:44:38.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 260462 6.81 MB/sec execute 79 sec latency 31.170 ms 2024-04-25T10:44:39.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 262142 6.83 MB/sec execute 80 sec latency 43.889 ms 2024-04-25T10:44:40.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 263198 6.82 MB/sec execute 81 sec latency 36.310 ms 2024-04-25T10:44:41.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 264930 6.82 MB/sec execute 82 sec latency 24.941 ms 2024-04-25T10:44:42.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 266215 6.87 MB/sec execute 83 sec latency 12.696 ms 2024-04-25T10:44:43.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 266887 6.81 MB/sec execute 84 sec latency 31.370 ms 2024-04-25T10:44:44.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 268468 6.81 MB/sec execute 85 sec latency 41.313 ms 2024-04-25T10:44:45.875 INFO:tasks.workunit.client.0.smithi016.stdout: 1 269870 6.86 MB/sec execute 86 sec latency 48.116 ms 2024-04-25T10:44:46.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 270671 6.81 MB/sec execute 87 sec latency 27.448 ms 2024-04-25T10:44:47.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 272193 6.80 MB/sec execute 88 sec latency 18.731 ms 2024-04-25T10:44:48.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 273376 6.85 MB/sec execute 89 sec latency 19.126 ms 2024-04-25T10:44:49.422 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:44:49.426 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:44:49.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 273873 6.78 MB/sec execute 90 sec latency 131.072 ms 2024-04-25T10:44:50.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 275329 6.76 MB/sec execute 91 sec latency 99.407 ms 2024-04-25T10:44:51.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 276802 6.82 MB/sec execute 92 sec latency 26.747 ms 2024-04-25T10:44:52.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 277415 6.76 MB/sec execute 93 sec latency 40.803 ms 2024-04-25T10:44:53.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 279083 6.76 MB/sec execute 94 sec latency 30.837 ms 2024-04-25T10:44:54.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 280453 6.82 MB/sec execute 95 sec latency 13.672 ms 2024-04-25T10:44:55.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 280984 6.75 MB/sec execute 96 sec latency 59.544 ms 2024-04-25T10:44:56.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 282720 6.76 MB/sec execute 97 sec latency 17.384 ms 2024-04-25T10:44:57.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 284019 6.80 MB/sec execute 98 sec latency 30.956 ms 2024-04-25T10:44:58.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 284753 6.75 MB/sec execute 99 sec latency 36.987 ms 2024-04-25T10:44:59.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 286678 6.79 MB/sec execute 100 sec latency 15.708 ms 2024-04-25T10:45:00.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 287651 6.79 MB/sec execute 101 sec latency 41.944 ms 2024-04-25T10:45:01.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 288838 6.78 MB/sec execute 102 sec latency 34.811 ms 2024-04-25T10:45:02.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 290702 6.80 MB/sec execute 103 sec latency 14.185 ms 2024-04-25T10:45:03.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 291433 6.78 MB/sec execute 104 sec latency 27.609 ms 2024-04-25T10:45:04.876 INFO:tasks.workunit.client.0.smithi016.stdout: 1 292579 6.77 MB/sec execute 105 sec latency 37.602 ms 2024-04-25T10:45:05.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 294377 6.82 MB/sec execute 106 sec latency 39.262 ms 2024-04-25T10:45:06.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 295158 6.77 MB/sec execute 107 sec latency 30.273 ms 2024-04-25T10:45:07.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 296881 6.77 MB/sec execute 108 sec latency 22.429 ms 2024-04-25T10:45:08.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 298238 6.82 MB/sec execute 109 sec latency 12.797 ms 2024-04-25T10:45:09.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 299042 6.78 MB/sec execute 110 sec latency 38.970 ms 2024-04-25T10:45:10.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 300741 6.80 MB/sec execute 111 sec latency 61.761 ms 2024-04-25T10:45:11.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 301997 6.81 MB/sec execute 112 sec latency 33.213 ms 2024-04-25T10:45:12.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 303333 6.80 MB/sec execute 113 sec latency 35.652 ms 2024-04-25T10:45:13.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 305186 6.85 MB/sec execute 114 sec latency 11.399 ms 2024-04-25T10:45:14.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 305807 6.80 MB/sec execute 115 sec latency 50.258 ms 2024-04-25T10:45:15.877 INFO:tasks.workunit.client.0.smithi016.stdout: 1 307450 6.80 MB/sec execute 116 sec latency 83.475 ms 2024-04-25T10:45:16.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 308858 6.84 MB/sec execute 117 sec latency 31.676 ms 2024-04-25T10:45:17.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 309556 6.79 MB/sec execute 118 sec latency 38.532 ms 2024-04-25T10:45:18.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 311371 6.82 MB/sec execute 119 sec latency 18.934 ms 2024-04-25T10:45:19.803 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:45:19.807 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:45:19.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 312467 6.83 MB/sec execute 120 sec latency 15.788 ms 2024-04-25T10:45:20.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 313297 6.79 MB/sec execute 121 sec latency 47.335 ms 2024-04-25T10:45:21.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 315177 6.83 MB/sec execute 122 sec latency 41.381 ms 2024-04-25T10:45:22.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 316239 6.82 MB/sec execute 123 sec latency 50.280 ms 2024-04-25T10:45:23.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 318073 6.82 MB/sec execute 124 sec latency 36.068 ms 2024-04-25T10:45:24.878 INFO:tasks.workunit.client.0.smithi016.stdout: 1 319458 6.86 MB/sec execute 125 sec latency 14.030 ms 2024-04-25T10:45:25.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 320001 6.81 MB/sec execute 126 sec latency 70.886 ms 2024-04-25T10:45:26.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 321688 6.81 MB/sec execute 127 sec latency 37.538 ms 2024-04-25T10:45:27.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 323103 6.85 MB/sec execute 128 sec latency 30.710 ms 2024-04-25T10:45:28.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 323962 6.82 MB/sec execute 129 sec latency 65.212 ms 2024-04-25T10:45:29.879 INFO:tasks.workunit.client.0.smithi016.stdout: 1 325554 6.83 MB/sec execute 130 sec latency 19.111 ms 2024-04-25T10:45:30.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 326640 6.84 MB/sec execute 131 sec latency 15.448 ms 2024-04-25T10:45:31.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 327473 6.81 MB/sec execute 132 sec latency 51.940 ms 2024-04-25T10:45:32.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 329347 6.84 MB/sec execute 133 sec latency 28.768 ms 2024-04-25T10:45:33.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 330273 6.83 MB/sec execute 134 sec latency 36.626 ms 2024-04-25T10:45:34.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 331106 6.80 MB/sec execute 135 sec latency 35.606 ms 2024-04-25T10:45:35.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 332805 6.82 MB/sec execute 136 sec latency 57.587 ms 2024-04-25T10:45:36.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 333863 6.82 MB/sec execute 137 sec latency 87.735 ms 2024-04-25T10:45:37.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 335123 6.81 MB/sec execute 138 sec latency 41.043 ms 2024-04-25T10:45:38.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 336984 6.85 MB/sec execute 139 sec latency 48.998 ms 2024-04-25T10:45:39.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 337662 6.82 MB/sec execute 140 sec latency 22.635 ms 2024-04-25T10:45:40.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 339313 6.81 MB/sec execute 141 sec latency 27.827 ms 2024-04-25T10:45:41.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 340592 6.84 MB/sec execute 142 sec latency 118.330 ms 2024-04-25T10:45:42.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 341258 6.81 MB/sec execute 143 sec latency 36.309 ms 2024-04-25T10:45:43.880 INFO:tasks.workunit.client.0.smithi016.stdout: 1 342920 6.81 MB/sec execute 144 sec latency 24.487 ms 2024-04-25T10:45:44.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 344213 6.83 MB/sec execute 145 sec latency 15.439 ms 2024-04-25T10:45:45.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 344649 6.80 MB/sec execute 146 sec latency 255.822 ms 2024-04-25T10:45:46.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 345982 6.79 MB/sec execute 147 sec latency 84.009 ms 2024-04-25T10:45:47.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 347720 6.82 MB/sec execute 148 sec latency 41.016 ms 2024-04-25T10:45:48.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 348355 6.79 MB/sec execute 149 sec latency 33.699 ms 2024-04-25T10:45:49.859 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:45:49.862 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:45:49.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 350061 6.79 MB/sec execute 150 sec latency 35.084 ms 2024-04-25T10:45:50.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 351450 6.82 MB/sec execute 151 sec latency 13.950 ms 2024-04-25T10:45:51.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 352217 6.79 MB/sec execute 152 sec latency 33.676 ms 2024-04-25T10:45:52.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 354138 6.82 MB/sec execute 153 sec latency 33.812 ms 2024-04-25T10:45:53.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 355083 6.81 MB/sec execute 154 sec latency 20.610 ms 2024-04-25T10:45:54.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 355989 6.79 MB/sec execute 155 sec latency 14.699 ms 2024-04-25T10:45:55.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 357973 6.82 MB/sec execute 156 sec latency 40.153 ms 2024-04-25T10:45:56.881 INFO:tasks.workunit.client.0.smithi016.stdout: 1 358701 6.81 MB/sec execute 157 sec latency 43.308 ms 2024-04-25T10:45:57.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 359908 6.80 MB/sec execute 158 sec latency 23.317 ms 2024-04-25T10:45:58.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 361766 6.83 MB/sec execute 159 sec latency 21.398 ms 2024-04-25T10:45:59.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 362344 6.80 MB/sec execute 160 sec latency 18.302 ms 2024-04-25T10:46:00.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 363495 6.79 MB/sec execute 161 sec latency 35.480 ms 2024-04-25T10:46:01.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 365168 6.80 MB/sec execute 162 sec latency 39.807 ms 2024-04-25T10:46:02.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 366099 6.79 MB/sec execute 163 sec latency 29.964 ms 2024-04-25T10:46:03.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 367836 6.80 MB/sec execute 164 sec latency 24.965 ms 2024-04-25T10:46:04.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 369106 6.82 MB/sec execute 165 sec latency 17.743 ms 2024-04-25T10:46:05.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 369664 6.79 MB/sec execute 166 sec latency 36.461 ms 2024-04-25T10:46:06.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 371274 6.78 MB/sec execute 167 sec latency 82.261 ms 2024-04-25T10:46:07.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 372736 6.81 MB/sec execute 168 sec latency 25.169 ms 2024-04-25T10:46:08.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 373689 6.79 MB/sec execute 169 sec latency 24.538 ms 2024-04-25T10:46:09.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 375618 6.81 MB/sec execute 170 sec latency 24.316 ms 2024-04-25T10:46:10.882 INFO:tasks.workunit.client.0.smithi016.stdout: 1 376432 6.81 MB/sec execute 171 sec latency 54.726 ms 2024-04-25T10:46:11.885 INFO:tasks.workunit.client.0.smithi016.stdout: 1 377583 6.80 MB/sec execute 172 sec latency 51.535 ms 2024-04-25T10:46:12.885 INFO:tasks.workunit.client.0.smithi016.stdout: 1 379521 6.83 MB/sec execute 173 sec latency 86.192 ms 2024-04-25T10:46:13.885 INFO:tasks.workunit.client.0.smithi016.stdout: 1 380229 6.80 MB/sec execute 174 sec latency 25.615 ms 2024-04-25T10:46:14.885 INFO:tasks.workunit.client.0.smithi016.stdout: 1 381868 6.80 MB/sec execute 175 sec latency 35.061 ms 2024-04-25T10:46:15.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 383224 6.82 MB/sec execute 176 sec latency 27.591 ms 2024-04-25T10:46:16.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 384017 6.80 MB/sec execute 177 sec latency 29.378 ms 2024-04-25T10:46:17.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 385530 6.80 MB/sec execute 178 sec latency 79.323 ms 2024-04-25T10:46:18.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 386890 6.82 MB/sec execute 179 sec latency 45.908 ms 2024-04-25T10:46:19.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 387479 6.79 MB/sec execute 180 sec latency 37.335 ms 2024-04-25T10:46:19.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:46:19.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:46:20.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 389251 6.79 MB/sec execute 181 sec latency 24.212 ms 2024-04-25T10:46:21.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 390435 6.82 MB/sec execute 182 sec latency 18.554 ms 2024-04-25T10:46:22.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 391093 6.78 MB/sec execute 183 sec latency 95.039 ms 2024-04-25T10:46:23.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 392801 6.79 MB/sec execute 184 sec latency 60.232 ms 2024-04-25T10:46:24.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 393999 6.81 MB/sec execute 185 sec latency 19.105 ms 2024-04-25T10:46:25.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 394640 6.78 MB/sec execute 186 sec latency 37.399 ms 2024-04-25T10:46:26.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 396265 6.78 MB/sec execute 187 sec latency 25.941 ms 2024-04-25T10:46:27.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 397554 6.80 MB/sec execute 188 sec latency 111.383 ms 2024-04-25T10:46:28.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 398302 6.77 MB/sec execute 189 sec latency 53.475 ms 2024-04-25T10:46:29.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 400203 6.79 MB/sec execute 190 sec latency 38.344 ms 2024-04-25T10:46:30.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 401218 6.80 MB/sec execute 191 sec latency 15.847 ms 2024-04-25T10:46:31.886 INFO:tasks.workunit.client.0.smithi016.stdout: 1 402311 6.79 MB/sec execute 192 sec latency 32.894 ms 2024-04-25T10:46:32.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 404032 6.79 MB/sec execute 193 sec latency 92.224 ms 2024-04-25T10:46:33.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 404935 6.79 MB/sec execute 194 sec latency 22.789 ms 2024-04-25T10:46:34.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 406604 6.78 MB/sec execute 195 sec latency 28.045 ms 2024-04-25T10:46:35.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 408031 6.81 MB/sec execute 196 sec latency 13.998 ms 2024-04-25T10:46:36.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 408568 6.78 MB/sec execute 197 sec latency 20.481 ms 2024-04-25T10:46:37.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 410315 6.78 MB/sec execute 198 sec latency 92.921 ms 2024-04-25T10:46:38.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 411734 6.81 MB/sec execute 199 sec latency 36.191 ms 2024-04-25T10:46:39.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 412404 6.78 MB/sec execute 200 sec latency 35.626 ms 2024-04-25T10:46:40.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 414287 6.80 MB/sec execute 201 sec latency 27.902 ms 2024-04-25T10:46:41.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 415429 6.80 MB/sec execute 202 sec latency 14.147 ms 2024-04-25T10:46:42.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 416425 6.80 MB/sec execute 203 sec latency 75.459 ms 2024-04-25T10:46:43.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 418207 6.80 MB/sec execute 204 sec latency 35.059 ms 2024-04-25T10:46:44.887 INFO:tasks.workunit.client.0.smithi016.stdout: 1 419092 6.80 MB/sec execute 205 sec latency 13.883 ms 2024-04-25T10:46:45.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 420429 6.79 MB/sec execute 206 sec latency 34.372 ms 2024-04-25T10:46:46.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 422190 6.82 MB/sec execute 207 sec latency 14.523 ms 2024-04-25T10:46:47.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 422751 6.79 MB/sec execute 208 sec latency 60.278 ms 2024-04-25T10:46:48.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 424574 6.79 MB/sec execute 209 sec latency 45.538 ms 2024-04-25T10:46:49.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 425890 6.82 MB/sec execute 210 sec latency 17.829 ms 2024-04-25T10:46:50.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:46:50.025 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:46:50.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 426362 6.79 MB/sec execute 211 sec latency 192.120 ms 2024-04-25T10:46:51.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 427874 6.78 MB/sec execute 212 sec latency 18.032 ms 2024-04-25T10:46:52.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 429282 6.81 MB/sec execute 213 sec latency 72.042 ms 2024-04-25T10:46:53.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 430146 6.78 MB/sec execute 214 sec latency 35.061 ms 2024-04-25T10:46:54.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 431804 6.79 MB/sec execute 215 sec latency 28.960 ms 2024-04-25T10:46:55.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 433019 6.80 MB/sec execute 216 sec latency 23.597 ms 2024-04-25T10:46:56.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 433758 6.78 MB/sec execute 217 sec latency 29.351 ms 2024-04-25T10:46:57.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 435480 6.79 MB/sec execute 218 sec latency 19.788 ms 2024-04-25T10:46:58.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 436631 6.80 MB/sec execute 219 sec latency 107.581 ms 2024-04-25T10:46:59.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 437477 6.78 MB/sec execute 220 sec latency 38.369 ms 2024-04-25T10:47:00.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 439535 6.80 MB/sec execute 221 sec latency 15.908 ms 2024-04-25T10:47:01.888 INFO:tasks.workunit.client.0.smithi016.stdout: 1 440413 6.79 MB/sec execute 222 sec latency 13.029 ms 2024-04-25T10:47:02.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 441822 6.79 MB/sec execute 223 sec latency 36.930 ms 2024-04-25T10:47:03.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 443474 6.81 MB/sec execute 224 sec latency 133.782 ms 2024-04-25T10:47:04.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 444128 6.79 MB/sec execute 225 sec latency 35.684 ms 2024-04-25T10:47:05.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 445840 6.79 MB/sec execute 226 sec latency 26.125 ms 2024-04-25T10:47:06.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 447195 6.81 MB/sec execute 227 sec latency 21.562 ms 2024-04-25T10:47:07.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 447926 6.79 MB/sec execute 228 sec latency 40.068 ms 2024-04-25T10:47:08.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 449840 6.81 MB/sec execute 229 sec latency 51.955 ms 2024-04-25T10:47:09.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 450883 6.81 MB/sec execute 230 sec latency 23.686 ms 2024-04-25T10:47:10.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 451753 6.79 MB/sec execute 231 sec latency 44.830 ms 2024-04-25T10:47:11.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 453517 6.80 MB/sec execute 232 sec latency 18.503 ms 2024-04-25T10:47:12.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 454503 6.80 MB/sec execute 233 sec latency 14.150 ms 2024-04-25T10:47:13.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 455813 6.80 MB/sec execute 234 sec latency 108.475 ms 2024-04-25T10:47:14.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 457670 6.82 MB/sec execute 235 sec latency 26.383 ms 2024-04-25T10:47:15.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 458252 6.80 MB/sec execute 236 sec latency 76.558 ms 2024-04-25T10:47:16.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 459065 6.86 MB/sec execute 237 sec latency 98.822 ms 2024-04-25T10:47:17.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 460669 6.86 MB/sec execute 238 sec latency 17.370 ms 2024-04-25T10:47:18.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 462060 6.87 MB/sec execute 239 sec latency 95.235 ms 2024-04-25T10:47:19.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 462817 6.85 MB/sec execute 240 sec latency 27.358 ms 2024-04-25T10:47:20.535 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:47:20.539 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:47:20.889 INFO:tasks.workunit.client.0.smithi016.stdout: 1 464510 6.86 MB/sec execute 241 sec latency 19.672 ms 2024-04-25T10:47:21.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 465762 6.87 MB/sec execute 242 sec latency 14.066 ms 2024-04-25T10:47:22.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 466600 6.85 MB/sec execute 243 sec latency 33.608 ms 2024-04-25T10:47:23.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 468360 6.87 MB/sec execute 244 sec latency 43.260 ms 2024-04-25T10:47:24.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 469408 6.87 MB/sec execute 245 sec latency 38.124 ms 2024-04-25T10:47:25.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 470481 6.86 MB/sec execute 246 sec latency 55.275 ms 2024-04-25T10:47:26.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 472193 6.87 MB/sec execute 247 sec latency 15.576 ms 2024-04-25T10:47:27.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 473017 6.86 MB/sec execute 248 sec latency 16.855 ms 2024-04-25T10:47:28.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 474231 6.86 MB/sec execute 249 sec latency 32.185 ms 2024-04-25T10:47:29.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 476204 6.88 MB/sec execute 250 sec latency 37.313 ms 2024-04-25T10:47:30.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 476776 6.86 MB/sec execute 251 sec latency 58.466 ms 2024-04-25T10:47:31.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 478466 6.86 MB/sec execute 252 sec latency 17.658 ms 2024-04-25T10:47:32.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 479788 6.87 MB/sec execute 253 sec latency 29.990 ms 2024-04-25T10:47:33.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 480401 6.85 MB/sec execute 254 sec latency 56.289 ms 2024-04-25T10:47:34.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 482276 6.86 MB/sec execute 255 sec latency 45.546 ms 2024-04-25T10:47:35.890 INFO:tasks.workunit.client.0.smithi016.stdout: 1 483556 6.87 MB/sec execute 256 sec latency 14.563 ms 2024-04-25T10:47:36.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 484425 6.85 MB/sec execute 257 sec latency 27.714 ms 2024-04-25T10:47:37.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 486116 6.86 MB/sec execute 258 sec latency 25.331 ms 2024-04-25T10:47:38.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 487178 6.87 MB/sec execute 259 sec latency 31.205 ms 2024-04-25T10:47:39.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 488214 6.86 MB/sec execute 260 sec latency 64.006 ms 2024-04-25T10:47:40.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 489935 6.86 MB/sec execute 261 sec latency 18.889 ms 2024-04-25T10:47:41.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 490768 6.86 MB/sec execute 262 sec latency 18.378 ms 2024-04-25T10:47:42.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 491838 6.85 MB/sec execute 263 sec latency 35.140 ms 2024-04-25T10:47:43.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 493798 6.87 MB/sec execute 264 sec latency 33.423 ms 2024-04-25T10:47:44.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 494528 6.86 MB/sec execute 265 sec latency 63.204 ms 2024-04-25T10:47:45.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 496052 6.85 MB/sec execute 266 sec latency 20.021 ms 2024-04-25T10:47:46.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 497484 6.87 MB/sec execute 267 sec latency 18.263 ms 2024-04-25T10:47:47.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 498081 6.85 MB/sec execute 268 sec latency 36.286 ms 2024-04-25T10:47:48.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 499748 6.85 MB/sec execute 269 sec latency 75.126 ms 2024-04-25T10:47:49.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 501082 6.86 MB/sec execute 270 sec latency 64.258 ms 2024-04-25T10:47:50.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 501849 6.85 MB/sec execute 271 sec latency 28.322 ms 2024-04-25T10:47:51.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:47:51.644 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:47:51.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 503812 6.86 MB/sec execute 272 sec latency 24.595 ms 2024-04-25T10:47:52.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 504852 6.86 MB/sec execute 273 sec latency 32.604 ms 2024-04-25T10:47:53.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 505753 6.85 MB/sec execute 274 sec latency 35.098 ms 2024-04-25T10:47:54.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 507662 6.86 MB/sec execute 275 sec latency 40.807 ms 2024-04-25T10:47:55.891 INFO:tasks.workunit.client.0.smithi016.stdout: 1 508474 6.86 MB/sec execute 276 sec latency 13.881 ms 2024-04-25T10:47:56.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 509625 6.85 MB/sec execute 277 sec latency 35.642 ms 2024-04-25T10:47:57.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 511383 6.86 MB/sec execute 278 sec latency 36.158 ms 2024-04-25T10:47:58.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 512115 6.85 MB/sec execute 279 sec latency 14.770 ms 2024-04-25T10:47:59.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 513218 6.85 MB/sec execute 280 sec latency 119.464 ms 2024-04-25T10:48:00.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 515198 6.87 MB/sec execute 281 sec latency 11.715 ms 2024-04-25T10:48:01.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 515859 6.85 MB/sec execute 282 sec latency 33.747 ms 2024-04-25T10:48:02.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 517541 6.85 MB/sec execute 283 sec latency 19.766 ms 2024-04-25T10:48:03.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 518903 6.87 MB/sec execute 284 sec latency 14.233 ms 2024-04-25T10:48:04.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 519641 6.85 MB/sec execute 285 sec latency 40.718 ms 2024-04-25T10:48:05.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 521544 6.86 MB/sec execute 286 sec latency 30.418 ms 2024-04-25T10:48:06.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 522597 6.86 MB/sec execute 287 sec latency 13.754 ms 2024-04-25T10:48:07.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 523649 6.86 MB/sec execute 288 sec latency 53.096 ms 2024-04-25T10:48:08.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 525553 6.86 MB/sec execute 289 sec latency 13.603 ms 2024-04-25T10:48:09.892 INFO:tasks.workunit.client.0.smithi016.stdout: 1 526233 6.86 MB/sec execute 290 sec latency 145.790 ms 2024-04-25T10:48:10.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 527293 6.85 MB/sec execute 291 sec latency 38.281 ms 2024-04-25T10:48:11.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 529137 6.86 MB/sec execute 292 sec latency 72.595 ms 2024-04-25T10:48:12.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 529842 6.85 MB/sec execute 293 sec latency 27.138 ms 2024-04-25T10:48:13.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 530947 6.85 MB/sec execute 294 sec latency 31.739 ms 2024-04-25T10:48:14.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 532608 6.85 MB/sec execute 295 sec latency 88.848 ms 2024-04-25T10:48:15.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 533449 6.85 MB/sec execute 296 sec latency 30.134 ms 2024-04-25T10:48:16.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 535234 6.85 MB/sec execute 297 sec latency 48.862 ms 2024-04-25T10:48:17.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 536571 6.86 MB/sec execute 298 sec latency 15.898 ms 2024-04-25T10:48:18.893 INFO:tasks.workunit.client.0.smithi016.stdout: 1 537304 6.84 MB/sec execute 299 sec latency 20.427 ms 2024-04-25T10:48:19.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 538860 6.84 MB/sec execute 300 sec latency 30.122 ms 2024-04-25T10:48:20.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 540134 6.86 MB/sec execute 301 sec latency 126.273 ms 2024-04-25T10:48:21.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:48:21.699 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:48:21.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 540731 6.84 MB/sec execute 302 sec latency 54.680 ms 2024-04-25T10:48:22.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 542369 6.84 MB/sec execute 303 sec latency 19.195 ms 2024-04-25T10:48:23.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 543633 6.85 MB/sec execute 304 sec latency 15.465 ms 2024-04-25T10:48:24.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 544209 6.83 MB/sec execute 305 sec latency 21.547 ms 2024-04-25T10:48:25.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 545412 6.83 MB/sec execute 306 sec latency 83.697 ms 2024-04-25T10:48:26.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 547175 6.85 MB/sec execute 307 sec latency 21.054 ms 2024-04-25T10:48:27.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 547791 6.83 MB/sec execute 308 sec latency 19.198 ms 2024-04-25T10:48:28.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 549460 6.83 MB/sec execute 309 sec latency 26.471 ms 2024-04-25T10:48:29.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 550777 6.84 MB/sec execute 310 sec latency 13.844 ms 2024-04-25T10:48:30.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 551351 6.83 MB/sec execute 311 sec latency 42.494 ms 2024-04-25T10:48:31.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 553063 6.83 MB/sec execute 312 sec latency 40.901 ms 2024-04-25T10:48:32.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 554415 6.84 MB/sec execute 313 sec latency 23.664 ms 2024-04-25T10:48:33.894 INFO:tasks.workunit.client.0.smithi016.stdout: 1 555140 6.82 MB/sec execute 314 sec latency 43.717 ms 2024-04-25T10:48:34.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 556943 6.83 MB/sec execute 315 sec latency 24.837 ms 2024-04-25T10:48:35.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 558097 6.84 MB/sec execute 316 sec latency 51.753 ms 2024-04-25T10:48:36.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 559327 6.83 MB/sec execute 317 sec latency 38.600 ms 2024-04-25T10:48:37.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 561311 6.85 MB/sec execute 318 sec latency 15.434 ms 2024-04-25T10:48:38.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 561873 6.83 MB/sec execute 319 sec latency 17.578 ms 2024-04-25T10:48:39.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 563690 6.83 MB/sec execute 320 sec latency 23.690 ms 2024-04-25T10:48:40.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 565027 6.85 MB/sec execute 321 sec latency 66.078 ms 2024-04-25T10:48:41.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 565784 6.83 MB/sec execute 322 sec latency 38.284 ms 2024-04-25T10:48:42.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 567590 6.84 MB/sec execute 323 sec latency 19.075 ms 2024-04-25T10:48:43.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 568621 6.84 MB/sec execute 324 sec latency 24.639 ms 2024-04-25T10:48:44.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 569337 6.83 MB/sec execute 325 sec latency 39.962 ms 2024-04-25T10:48:45.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 570822 6.83 MB/sec execute 326 sec latency 40.131 ms 2024-04-25T10:48:46.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 572156 6.84 MB/sec execute 327 sec latency 34.864 ms 2024-04-25T10:48:47.895 INFO:tasks.workunit.client.0.smithi016.stdout: 1 572771 6.82 MB/sec execute 328 sec latency 55.880 ms 2024-04-25T10:48:48.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 574341 6.82 MB/sec execute 329 sec latency 56.098 ms 2024-04-25T10:48:49.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 575643 6.84 MB/sec execute 330 sec latency 15.118 ms 2024-04-25T10:48:50.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 576119 6.82 MB/sec execute 331 sec latency 58.252 ms 2024-04-25T10:48:51.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 577876 6.82 MB/sec execute 332 sec latency 24.095 ms 2024-04-25T10:48:52.136 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:48:52.140 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:48:52.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 579233 6.83 MB/sec execute 333 sec latency 36.095 ms 2024-04-25T10:48:53.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 579956 6.82 MB/sec execute 334 sec latency 40.826 ms 2024-04-25T10:48:54.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 581974 6.83 MB/sec execute 335 sec latency 34.604 ms 2024-04-25T10:48:55.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 582912 6.83 MB/sec execute 336 sec latency 63.033 ms 2024-04-25T10:48:56.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 584198 6.82 MB/sec execute 337 sec latency 18.819 ms 2024-04-25T10:48:57.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 585869 6.83 MB/sec execute 338 sec latency 117.644 ms 2024-04-25T10:48:58.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 586620 6.83 MB/sec execute 339 sec latency 22.711 ms 2024-04-25T10:48:59.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 587775 6.82 MB/sec execute 340 sec latency 20.645 ms 2024-04-25T10:49:00.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 589429 6.83 MB/sec execute 341 sec latency 71.768 ms 2024-04-25T10:49:01.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 590287 6.82 MB/sec execute 342 sec latency 49.381 ms 2024-04-25T10:49:02.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 591950 6.82 MB/sec execute 343 sec latency 45.106 ms 2024-04-25T10:49:03.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 593385 6.84 MB/sec execute 344 sec latency 42.870 ms 2024-04-25T10:49:04.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 594077 6.82 MB/sec execute 345 sec latency 35.048 ms 2024-04-25T10:49:05.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 595926 6.83 MB/sec execute 346 sec latency 43.422 ms 2024-04-25T10:49:06.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 597001 6.83 MB/sec execute 347 sec latency 106.838 ms 2024-04-25T10:49:07.896 INFO:tasks.workunit.client.0.smithi016.stdout: 1 597898 6.82 MB/sec execute 348 sec latency 28.439 ms 2024-04-25T10:49:08.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 599934 6.83 MB/sec execute 349 sec latency 36.698 ms 2024-04-25T10:49:09.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 600720 6.83 MB/sec execute 350 sec latency 26.831 ms 2024-04-25T10:49:10.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 601814 6.82 MB/sec execute 351 sec latency 42.425 ms 2024-04-25T10:49:11.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 603548 6.83 MB/sec execute 352 sec latency 75.789 ms 2024-04-25T10:49:12.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 604327 6.83 MB/sec execute 353 sec latency 25.099 ms 2024-04-25T10:49:13.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 605783 6.82 MB/sec execute 354 sec latency 18.884 ms 2024-04-25T10:49:14.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 607430 6.84 MB/sec execute 355 sec latency 13.888 ms 2024-04-25T10:49:15.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 608011 6.82 MB/sec execute 356 sec latency 30.586 ms 2024-04-25T10:49:16.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 609528 6.82 MB/sec execute 357 sec latency 70.227 ms 2024-04-25T10:49:17.897 INFO:tasks.workunit.client.0.smithi016.stdout: 1 610999 6.83 MB/sec execute 358 sec latency 36.905 ms 2024-04-25T10:49:18.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 611616 6.82 MB/sec execute 359 sec latency 47.898 ms 2024-04-25T10:49:19.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 612737 6.81 MB/sec execute 360 sec latency 22.877 ms 2024-04-25T10:49:20.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 614241 6.82 MB/sec execute 361 sec latency 20.556 ms 2024-04-25T10:49:21.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 614912 6.81 MB/sec execute 362 sec latency 58.739 ms 2024-04-25T10:49:22.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:49:22.487 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:49:22.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 616216 6.81 MB/sec execute 363 sec latency 37.212 ms 2024-04-25T10:49:23.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 617813 6.82 MB/sec execute 364 sec latency 30.308 ms 2024-04-25T10:49:24.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 618650 6.81 MB/sec execute 365 sec latency 26.942 ms 2024-04-25T10:49:25.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 620343 6.81 MB/sec execute 366 sec latency 34.117 ms 2024-04-25T10:49:26.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 621661 6.82 MB/sec execute 367 sec latency 61.151 ms 2024-04-25T10:49:27.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 622411 6.81 MB/sec execute 368 sec latency 40.608 ms 2024-04-25T10:49:28.898 INFO:tasks.workunit.client.0.smithi016.stdout: 1 624419 6.82 MB/sec execute 369 sec latency 27.906 ms 2024-04-25T10:49:29.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 625381 6.82 MB/sec execute 370 sec latency 28.978 ms 2024-04-25T10:49:30.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 626076 6.81 MB/sec execute 371 sec latency 26.869 ms 2024-04-25T10:49:31.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 628066 6.82 MB/sec execute 372 sec latency 42.420 ms 2024-04-25T10:49:32.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 629113 6.82 MB/sec execute 373 sec latency 28.218 ms 2024-04-25T10:49:33.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 630312 6.81 MB/sec execute 374 sec latency 34.904 ms 2024-04-25T10:49:34.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 631825 6.82 MB/sec execute 375 sec latency 44.364 ms 2024-04-25T10:49:35.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 632598 6.81 MB/sec execute 376 sec latency 16.367 ms 2024-04-25T10:49:36.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 633654 6.81 MB/sec execute 377 sec latency 112.178 ms 2024-04-25T10:49:37.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 635352 6.81 MB/sec execute 378 sec latency 40.377 ms 2024-04-25T10:49:38.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 636125 6.81 MB/sec execute 379 sec latency 20.525 ms 2024-04-25T10:49:39.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 637162 6.81 MB/sec execute 380 sec latency 26.044 ms 2024-04-25T10:49:40.899 INFO:tasks.workunit.client.0.smithi016.stdout: 1 638681 6.81 MB/sec execute 381 sec latency 20.849 ms 2024-04-25T10:49:41.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 639510 6.81 MB/sec execute 382 sec latency 61.747 ms 2024-04-25T10:49:42.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 640508 6.80 MB/sec execute 383 sec latency 45.448 ms 2024-04-25T10:49:43.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 642237 6.80 MB/sec execute 384 sec latency 25.931 ms 2024-04-25T10:49:44.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 643202 6.80 MB/sec execute 385 sec latency 15.643 ms 2024-04-25T10:49:45.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 644330 6.80 MB/sec execute 386 sec latency 24.430 ms 2024-04-25T10:49:46.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 645994 6.80 MB/sec execute 387 sec latency 35.406 ms 2024-04-25T10:49:47.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 646911 6.80 MB/sec execute 388 sec latency 125.259 ms 2024-04-25T10:49:48.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 648129 6.80 MB/sec execute 389 sec latency 48.781 ms 2024-04-25T10:49:49.900 INFO:tasks.workunit.client.0.smithi016.stdout: 1 649876 6.81 MB/sec execute 390 sec latency 19.533 ms 2024-04-25T10:49:50.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 650557 6.80 MB/sec execute 391 sec latency 23.302 ms 2024-04-25T10:49:51.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 652238 6.80 MB/sec execute 392 sec latency 27.755 ms 2024-04-25T10:49:52.547 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:49:52.550 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:49:52.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 653583 6.81 MB/sec execute 393 sec latency 77.148 ms 2024-04-25T10:49:53.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 654241 6.80 MB/sec execute 394 sec latency 35.104 ms 2024-04-25T10:49:54.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 655918 6.80 MB/sec execute 395 sec latency 33.433 ms 2024-04-25T10:49:55.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 657193 6.81 MB/sec execute 396 sec latency 16.577 ms 2024-04-25T10:49:56.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 657856 6.79 MB/sec execute 397 sec latency 40.791 ms 2024-04-25T10:49:57.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 659401 6.79 MB/sec execute 398 sec latency 112.974 ms 2024-04-25T10:49:58.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 660768 6.80 MB/sec execute 399 sec latency 40.955 ms 2024-04-25T10:49:59.901 INFO:tasks.workunit.client.0.smithi016.stdout: 1 661342 6.79 MB/sec execute 400 sec latency 34.017 ms 2024-04-25T10:50:00.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 663298 6.80 MB/sec execute 401 sec latency 26.921 ms 2024-04-25T10:50:01.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 664353 6.80 MB/sec execute 402 sec latency 20.833 ms 2024-04-25T10:50:02.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 665142 6.79 MB/sec execute 403 sec latency 62.138 ms 2024-04-25T10:50:03.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 666917 6.80 MB/sec execute 404 sec latency 58.693 ms 2024-04-25T10:50:04.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 667914 6.80 MB/sec execute 405 sec latency 20.017 ms 2024-04-25T10:50:05.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 668691 6.79 MB/sec execute 406 sec latency 28.025 ms 2024-04-25T10:50:06.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 670536 6.80 MB/sec execute 407 sec latency 43.095 ms 2024-04-25T10:50:07.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 671478 6.79 MB/sec execute 408 sec latency 63.588 ms 2024-04-25T10:50:08.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 672327 6.78 MB/sec execute 409 sec latency 31.100 ms 2024-04-25T10:50:09.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 674013 6.79 MB/sec execute 410 sec latency 32.891 ms 2024-04-25T10:50:10.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 675035 6.79 MB/sec execute 411 sec latency 19.575 ms 2024-04-25T10:50:11.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 675944 6.78 MB/sec execute 412 sec latency 42.943 ms 2024-04-25T10:50:12.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 677269 6.78 MB/sec execute 413 sec latency 53.540 ms 2024-04-25T10:50:13.902 INFO:tasks.workunit.client.0.smithi016.stdout: 1 678588 6.79 MB/sec execute 414 sec latency 35.708 ms 2024-04-25T10:50:14.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 679402 6.78 MB/sec execute 415 sec latency 36.079 ms 2024-04-25T10:50:15.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 681228 6.79 MB/sec execute 416 sec latency 31.070 ms 2024-04-25T10:50:16.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 682230 6.79 MB/sec execute 417 sec latency 17.461 ms 2024-04-25T10:50:17.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 682950 6.77 MB/sec execute 418 sec latency 57.380 ms 2024-04-25T10:50:18.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 684757 6.78 MB/sec execute 419 sec latency 36.744 ms 2024-04-25T10:50:19.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 685810 6.78 MB/sec execute 420 sec latency 11.639 ms 2024-04-25T10:50:20.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 686995 6.78 MB/sec execute 421 sec latency 33.011 ms 2024-04-25T10:50:21.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 688889 6.79 MB/sec execute 422 sec latency 12.423 ms 2024-04-25T10:50:22.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:50:22.600 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:50:22.687 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T10:50:22.687+0000 7fd3ae3ac640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32171) UID: 0 2024-04-25T10:50:22.687 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T10:50:22.687+0000 7febe9fad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32171) UID: 0 2024-04-25T10:50:22.688 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T10:50:22.687+0000 7f947a115640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32171) UID: 0 2024-04-25T10:50:22.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 689501 6.78 MB/sec execute 423 sec latency 104.221 ms 2024-04-25T10:50:23.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 691326 6.78 MB/sec execute 424 sec latency 24.186 ms 2024-04-25T10:50:24.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 692730 6.79 MB/sec execute 425 sec latency 22.467 ms 2024-04-25T10:50:25.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 693460 6.78 MB/sec execute 426 sec latency 36.844 ms 2024-04-25T10:50:26.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 695471 6.79 MB/sec execute 427 sec latency 17.918 ms 2024-04-25T10:50:27.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 696457 6.79 MB/sec execute 428 sec latency 73.051 ms 2024-04-25T10:50:28.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 697847 6.79 MB/sec execute 429 sec latency 35.870 ms 2024-04-25T10:50:29.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 699677 6.80 MB/sec execute 430 sec latency 13.942 ms 2024-04-25T10:50:30.903 INFO:tasks.workunit.client.0.smithi016.stdout: 1 700268 6.79 MB/sec execute 431 sec latency 32.248 ms 2024-04-25T10:50:31.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 702142 6.79 MB/sec execute 432 sec latency 29.883 ms 2024-04-25T10:50:32.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 703455 6.80 MB/sec execute 433 sec latency 15.456 ms 2024-04-25T10:50:33.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 704319 6.79 MB/sec execute 434 sec latency 67.191 ms 2024-04-25T10:50:34.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 706403 6.80 MB/sec execute 435 sec latency 27.452 ms 2024-04-25T10:50:35.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 707265 6.80 MB/sec execute 436 sec latency 14.906 ms 2024-04-25T10:50:36.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 709011 6.80 MB/sec execute 437 sec latency 52.431 ms 2024-04-25T10:50:37.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 710463 6.81 MB/sec execute 438 sec latency 19.845 ms 2024-04-25T10:50:38.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 711147 6.80 MB/sec execute 439 sec latency 77.677 ms 2024-04-25T10:50:39.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 713244 6.81 MB/sec execute 440 sec latency 14.796 ms 2024-04-25T10:50:40.904 INFO:tasks.workunit.client.0.smithi016.stdout: 1 714361 6.81 MB/sec execute 441 sec latency 16.994 ms 2024-04-25T10:50:41.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 716155 6.81 MB/sec execute 442 sec latency 48.390 ms 2024-04-25T10:50:42.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 717555 6.82 MB/sec execute 443 sec latency 14.329 ms 2024-04-25T10:50:43.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 718294 6.81 MB/sec execute 444 sec latency 51.762 ms 2024-04-25T10:50:44.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 720307 6.82 MB/sec execute 445 sec latency 18.770 ms 2024-04-25T10:50:45.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 721408 6.82 MB/sec execute 446 sec latency 25.189 ms 2024-04-25T10:50:46.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 723153 6.82 MB/sec execute 447 sec latency 44.491 ms 2024-04-25T10:50:47.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 724484 6.83 MB/sec execute 448 sec latency 16.248 ms 2024-04-25T10:50:48.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 725137 6.81 MB/sec execute 449 sec latency 51.856 ms 2024-04-25T10:50:49.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 726859 6.81 MB/sec execute 450 sec latency 48.567 ms 2024-04-25T10:50:50.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 728316 6.83 MB/sec execute 451 sec latency 13.817 ms 2024-04-25T10:50:51.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 729399 6.82 MB/sec execute 452 sec latency 35.134 ms 2024-04-25T10:50:52.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 731318 6.83 MB/sec execute 453 sec latency 33.391 ms 2024-04-25T10:50:53.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 731949 6.82 MB/sec execute 454 sec latency 49.098 ms 2024-04-25T10:50:54.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 733163 6.82 MB/sec execute 455 sec latency 37.388 ms 2024-04-25T10:50:55.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 735112 6.83 MB/sec execute 456 sec latency 23.725 ms 2024-04-25T10:50:56.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 735961 6.82 MB/sec execute 457 sec latency 40.803 ms 2024-04-25T10:50:57.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 738244 6.83 MB/sec execute 458 sec latency 12.897 ms 2024-04-25T10:50:58.905 INFO:tasks.workunit.client.0.smithi016.stdout: 1 739191 6.83 MB/sec execute 459 sec latency 46.487 ms 2024-04-25T10:50:59.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 740993 6.83 MB/sec execute 460 sec latency 50.063 ms 2024-04-25T10:51:00.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 742424 6.84 MB/sec execute 461 sec latency 25.139 ms 2024-04-25T10:51:01.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 743513 6.84 MB/sec execute 462 sec latency 34.760 ms 2024-04-25T10:51:02.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 745478 6.85 MB/sec execute 463 sec latency 16.393 ms 2024-04-25T10:51:03.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 746250 6.84 MB/sec execute 464 sec latency 30.992 ms 2024-04-25T10:51:04.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 748106 6.84 MB/sec execute 465 sec latency 34.774 ms 2024-04-25T10:51:05.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 749487 6.85 MB/sec execute 466 sec latency 16.120 ms 2024-04-25T10:51:06.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 750505 6.84 MB/sec execute 467 sec latency 34.265 ms 2024-04-25T10:51:07.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 752391 6.85 MB/sec execute 468 sec latency 106.174 ms 2024-04-25T10:51:08.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 753154 6.85 MB/sec execute 469 sec latency 110.773 ms 2024-04-25T10:51:09.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 754327 6.85 MB/sec execute 470 sec latency 32.525 ms 2024-04-25T10:51:10.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 756326 6.86 MB/sec execute 471 sec latency 13.197 ms 2024-04-25T10:51:11.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 757140 6.85 MB/sec execute 472 sec latency 33.521 ms 2024-04-25T10:51:12.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 759528 6.86 MB/sec execute 473 sec latency 25.083 ms 2024-04-25T10:51:13.906 INFO:tasks.workunit.client.0.smithi016.stdout: 1 760488 6.86 MB/sec execute 474 sec latency 26.271 ms 2024-04-25T10:51:14.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 762356 6.86 MB/sec execute 475 sec latency 45.476 ms 2024-04-25T10:51:15.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 763787 6.87 MB/sec execute 476 sec latency 10.898 ms 2024-04-25T10:51:16.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 764940 6.87 MB/sec execute 477 sec latency 34.001 ms 2024-04-25T10:51:17.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 767075 6.88 MB/sec execute 478 sec latency 46.341 ms 2024-04-25T10:51:18.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 768124 6.87 MB/sec execute 479 sec latency 24.394 ms 2024-04-25T10:51:19.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 770283 6.88 MB/sec execute 480 sec latency 99.634 ms 2024-04-25T10:51:20.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 771119 6.88 MB/sec execute 481 sec latency 23.830 ms 2024-04-25T10:51:21.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 773101 6.88 MB/sec execute 482 sec latency 33.054 ms 2024-04-25T10:51:22.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 774471 6.89 MB/sec execute 483 sec latency 24.792 ms 2024-04-25T10:51:23.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 776028 6.89 MB/sec execute 484 sec latency 20.388 ms 2024-04-25T10:51:24.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 777713 6.90 MB/sec execute 485 sec latency 46.727 ms 2024-04-25T10:51:25.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 778659 6.89 MB/sec execute 486 sec latency 28.889 ms 2024-04-25T10:51:26.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 780778 6.90 MB/sec execute 487 sec latency 40.683 ms 2024-04-25T10:51:27.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 781856 6.90 MB/sec execute 488 sec latency 25.142 ms 2024-04-25T10:51:28.907 INFO:tasks.workunit.client.0.smithi016.stdout: 1 783574 6.90 MB/sec execute 489 sec latency 40.745 ms 2024-04-25T10:51:29.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 784944 6.91 MB/sec execute 490 sec latency 71.483 ms 2024-04-25T10:51:30.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 786106 6.90 MB/sec execute 491 sec latency 21.213 ms 2024-04-25T10:51:31.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 788325 6.91 MB/sec execute 492 sec latency 14.167 ms 2024-04-25T10:51:32.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 789113 6.91 MB/sec execute 493 sec latency 66.833 ms 2024-04-25T10:51:33.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 791152 6.92 MB/sec execute 494 sec latency 21.939 ms 2024-04-25T10:51:34.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 792148 6.91 MB/sec execute 495 sec latency 111.378 ms 2024-04-25T10:51:35.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 793579 6.91 MB/sec execute 496 sec latency 36.550 ms 2024-04-25T10:51:36.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 795531 6.92 MB/sec execute 497 sec latency 14.248 ms 2024-04-25T10:51:37.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 796194 6.91 MB/sec execute 498 sec latency 57.722 ms 2024-04-25T10:51:38.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 798216 6.92 MB/sec execute 499 sec latency 26.297 ms 2024-04-25T10:51:39.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 799254 6.92 MB/sec execute 500 sec latency 102.800 ms 2024-04-25T10:51:40.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 800818 6.92 MB/sec execute 501 sec latency 33.728 ms 2024-04-25T10:51:41.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 802679 6.93 MB/sec execute 502 sec latency 13.692 ms 2024-04-25T10:51:42.908 INFO:tasks.workunit.client.0.smithi016.stdout: 1 803662 6.92 MB/sec execute 503 sec latency 32.513 ms 2024-04-25T10:51:43.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 805952 6.94 MB/sec execute 504 sec latency 34.980 ms 2024-04-25T10:51:44.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 806640 6.93 MB/sec execute 505 sec latency 79.689 ms 2024-04-25T10:51:45.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 808525 6.93 MB/sec execute 506 sec latency 46.172 ms 2024-04-25T10:51:46.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 810089 6.94 MB/sec execute 507 sec latency 26.930 ms 2024-04-25T10:51:47.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 811971 6.94 MB/sec execute 508 sec latency 34.383 ms 2024-04-25T10:51:48.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 813423 6.95 MB/sec execute 509 sec latency 29.800 ms 2024-04-25T10:51:49.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 814303 6.94 MB/sec execute 510 sec latency 129.872 ms 2024-04-25T10:51:50.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 816534 6.96 MB/sec execute 511 sec latency 28.572 ms 2024-04-25T10:51:51.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 817394 6.95 MB/sec execute 512 sec latency 37.949 ms 2024-04-25T10:51:52.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 819470 6.95 MB/sec execute 513 sec latency 16.184 ms 2024-04-25T10:51:53.909 INFO:tasks.workunit.client.0.smithi016.stdout: 1 820617 6.96 MB/sec execute 514 sec latency 28.926 ms 2024-04-25T10:51:54.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 822531 6.96 MB/sec execute 515 sec latency 46.105 ms 2024-04-25T10:51:55.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 823798 6.96 MB/sec execute 516 sec latency 94.966 ms 2024-04-25T10:51:56.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 824673 6.95 MB/sec execute 517 sec latency 27.362 ms 2024-04-25T10:51:57.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 826606 6.96 MB/sec execute 518 sec latency 42.905 ms 2024-04-25T10:51:58.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 827644 6.96 MB/sec execute 519 sec latency 33.957 ms 2024-04-25T10:51:59.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 828734 6.96 MB/sec execute 520 sec latency 35.027 ms 2024-04-25T10:52:00.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 830578 6.96 MB/sec execute 521 sec latency 48.948 ms 2024-04-25T10:52:01.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 831497 6.96 MB/sec execute 522 sec latency 60.734 ms 2024-04-25T10:52:02.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 833153 6.96 MB/sec execute 523 sec latency 34.681 ms 2024-04-25T10:52:03.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 834465 6.97 MB/sec execute 524 sec latency 155.271 ms 2024-04-25T10:52:04.910 INFO:tasks.workunit.client.0.smithi016.stdout: 1 835108 6.96 MB/sec execute 525 sec latency 36.784 ms 2024-04-25T10:52:05.913 INFO:tasks.workunit.client.0.smithi016.stdout: 1 836735 6.96 MB/sec execute 526 sec latency 50.560 ms 2024-04-25T10:52:06.913 INFO:tasks.workunit.client.0.smithi016.stdout: 1 838173 6.97 MB/sec execute 527 sec latency 30.369 ms 2024-04-25T10:52:07.913 INFO:tasks.workunit.client.0.smithi016.stdout: 1 838863 6.95 MB/sec execute 528 sec latency 35.211 ms 2024-04-25T10:52:08.913 INFO:tasks.workunit.client.0.smithi016.stdout: 1 841246 6.97 MB/sec execute 529 sec latency 14.476 ms 2024-04-25T10:52:09.913 INFO:tasks.workunit.client.0.smithi016.stdout: 1 841983 6.96 MB/sec execute 530 sec latency 20.546 ms 2024-04-25T10:52:10.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 843800 6.96 MB/sec execute 531 sec latency 109.095 ms 2024-04-25T10:52:11.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 845361 6.97 MB/sec execute 532 sec latency 27.070 ms 2024-04-25T10:52:12.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 846430 6.97 MB/sec execute 533 sec latency 45.417 ms 2024-04-25T10:52:13.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 848703 6.98 MB/sec execute 534 sec latency 13.386 ms 2024-04-25T10:52:14.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 849364 6.97 MB/sec execute 535 sec latency 52.692 ms 2024-04-25T10:52:15.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 851042 6.97 MB/sec execute 536 sec latency 67.852 ms 2024-04-25T10:52:16.914 INFO:tasks.workunit.client.0.smithi016.stdout: 1 852565 6.98 MB/sec execute 537 sec latency 28.757 ms 2024-04-25T10:52:17.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 854090 6.98 MB/sec execute 538 sec latency 20.357 ms 2024-04-25T10:52:18.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 856016 6.99 MB/sec execute 539 sec latency 20.117 ms 2024-04-25T10:52:19.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 857105 6.99 MB/sec execute 540 sec latency 22.054 ms 2024-04-25T10:52:20.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 859182 6.99 MB/sec execute 541 sec latency 94.882 ms 2024-04-25T10:52:21.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 859954 6.99 MB/sec execute 542 sec latency 33.963 ms 2024-04-25T10:52:22.915 INFO:tasks.workunit.client.0.smithi016.stdout: 1 862078 6.99 MB/sec execute 543 sec latency 17.223 ms 2024-04-25T10:52:23.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 863172 6.99 MB/sec execute 544 sec latency 19.845 ms 2024-04-25T10:52:24.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 865091 6.99 MB/sec execute 545 sec latency 29.117 ms 2024-04-25T10:52:25.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 866529 7.00 MB/sec execute 546 sec latency 65.266 ms 2024-04-25T10:52:26.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 867746 7.00 MB/sec execute 547 sec latency 20.965 ms 2024-04-25T10:52:27.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 870062 7.01 MB/sec execute 548 sec latency 22.916 ms 2024-04-25T10:52:28.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 870626 7.00 MB/sec execute 549 sec latency 34.131 ms 2024-04-25T10:52:29.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 872614 7.01 MB/sec execute 550 sec latency 40.839 ms 2024-04-25T10:52:30.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 873756 7.01 MB/sec execute 551 sec latency 94.159 ms 2024-04-25T10:52:31.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 874914 7.01 MB/sec execute 552 sec latency 17.661 ms 2024-04-25T10:52:32.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 876594 7.01 MB/sec execute 553 sec latency 30.765 ms 2024-04-25T10:52:33.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 877385 7.01 MB/sec execute 554 sec latency 18.573 ms 2024-04-25T10:52:34.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 878457 7.00 MB/sec execute 555 sec latency 42.264 ms 2024-04-25T10:52:35.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 879842 7.00 MB/sec execute 556 sec latency 122.024 ms 2024-04-25T10:52:36.916 INFO:tasks.workunit.client.0.smithi016.stdout: 1 880867 7.00 MB/sec execute 557 sec latency 51.666 ms 2024-04-25T10:52:37.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 882085 7.00 MB/sec execute 558 sec latency 51.772 ms 2024-04-25T10:52:38.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 883983 7.01 MB/sec execute 559 sec latency 38.734 ms 2024-04-25T10:52:39.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 884495 7.00 MB/sec execute 560 sec latency 16.921 ms 2024-04-25T10:52:40.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 885657 7.00 MB/sec execute 561 sec latency 31.773 ms 2024-04-25T10:52:41.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 887345 7.00 MB/sec execute 562 sec latency 80.333 ms 2024-04-25T10:52:42.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 888035 7.00 MB/sec execute 563 sec latency 39.283 ms 2024-04-25T10:52:43.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 889460 6.99 MB/sec execute 564 sec latency 18.601 ms 2024-04-25T10:52:44.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 890915 7.00 MB/sec execute 565 sec latency 18.656 ms 2024-04-25T10:52:45.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 891543 6.99 MB/sec execute 566 sec latency 19.231 ms 2024-04-25T10:52:46.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 892571 6.99 MB/sec execute 567 sec latency 62.049 ms 2024-04-25T10:52:47.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 894471 6.99 MB/sec execute 568 sec latency 39.182 ms 2024-04-25T10:52:48.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 895276 6.99 MB/sec execute 569 sec latency 18.049 ms 2024-04-25T10:52:49.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 896528 6.99 MB/sec execute 570 sec latency 39.727 ms 2024-04-25T10:52:50.917 INFO:tasks.workunit.client.0.smithi016.stdout: 1 898284 7.00 MB/sec execute 571 sec latency 35.157 ms 2024-04-25T10:52:51.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 898888 6.99 MB/sec execute 572 sec latency 89.981 ms 2024-04-25T10:52:52.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 900460 6.98 MB/sec execute 573 sec latency 28.183 ms 2024-04-25T10:52:53.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 901752 6.99 MB/sec execute 574 sec latency 17.542 ms 2024-04-25T10:52:54.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 902368 6.98 MB/sec execute 575 sec latency 25.508 ms 2024-04-25T10:52:55.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 903716 6.98 MB/sec execute 576 sec latency 38.416 ms 2024-04-25T10:52:56.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 905365 6.99 MB/sec execute 577 sec latency 55.033 ms 2024-04-25T10:52:57.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 905979 6.98 MB/sec execute 578 sec latency 40.950 ms 2024-04-25T10:52:58.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 907668 6.98 MB/sec execute 579 sec latency 17.326 ms 2024-04-25T10:52:59.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 908986 6.99 MB/sec execute 580 sec latency 21.763 ms 2024-04-25T10:53:00.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:53:00.724 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:53:00.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 909809 6.98 MB/sec execute 581 sec latency 35.339 ms 2024-04-25T10:53:01.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 911343 6.98 MB/sec execute 582 sec latency 56.593 ms 2024-04-25T10:53:02.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 912692 6.99 MB/sec execute 583 sec latency 47.239 ms 2024-04-25T10:53:03.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 913536 6.98 MB/sec execute 584 sec latency 37.032 ms 2024-04-25T10:53:04.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 915372 6.98 MB/sec execute 585 sec latency 32.940 ms 2024-04-25T10:53:05.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 916345 6.98 MB/sec execute 586 sec latency 14.438 ms 2024-04-25T10:53:06.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 916977 6.99 MB/sec execute 587 sec latency 235.914 ms 2024-04-25T10:53:07.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 917956 7.00 MB/sec execute 588 sec latency 41.126 ms 2024-04-25T10:53:08.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 919613 7.00 MB/sec execute 589 sec latency 24.574 ms 2024-04-25T10:53:09.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 920647 7.00 MB/sec execute 590 sec latency 19.852 ms 2024-04-25T10:53:10.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 921426 7.00 MB/sec execute 591 sec latency 99.142 ms 2024-04-25T10:53:11.918 INFO:tasks.workunit.client.0.smithi016.stdout: 1 922854 6.99 MB/sec execute 592 sec latency 127.412 ms 2024-04-25T10:53:12.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 924184 7.00 MB/sec execute 593 sec latency 38.275 ms 2024-04-25T10:53:13.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 925021 6.99 MB/sec execute 594 sec latency 34.084 ms 2024-04-25T10:53:14.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 926690 7.00 MB/sec execute 595 sec latency 23.453 ms 2024-04-25T10:53:15.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 927662 7.00 MB/sec execute 596 sec latency 46.602 ms 2024-04-25T10:53:16.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 928315 6.99 MB/sec execute 597 sec latency 46.256 ms 2024-04-25T10:53:17.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 930240 6.99 MB/sec execute 598 sec latency 48.327 ms 2024-04-25T10:53:18.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 931285 6.99 MB/sec execute 599 sec latency 18.245 ms 2024-04-25T10:53:19.919 INFO:tasks.workunit.client.0.smithi016.stdout: 1 cleanup 600 sec 2024-04-25T10:53:20.247 INFO:tasks.workunit.client.0.smithi016.stdout: 0 cleanup 600 sec 2024-04-25T10:53:20.247 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T10:53:20.247 INFO:tasks.workunit.client.0.smithi016.stdout: Operation Count AvgLat MaxLat 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: NTCreateX 133323 1.659 192.110 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Close 97941 0.005 1.827 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Rename 5646 7.681 129.851 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Unlink 26919 3.077 131.055 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Deltree 4 158.849 235.905 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Mkdir 2 0.015 0.015 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Qpathinfo 120833 1.210 255.810 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Qfileinfo 21197 0.002 0.737 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Qfsinfo 22159 0.415 13.699 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Sfileinfo 10865 0.044 12.465 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: Find 46725 0.181 60.269 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: WriteX 66583 0.030 23.825 2024-04-25T10:53:20.248 INFO:tasks.workunit.client.0.smithi016.stdout: ReadX 209026 0.035 79.312 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout: LockX 434 1.614 23.701 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout: UnlockX 434 1.495 106.169 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout: Flush 9343 7.905 177.129 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout:Throughput 6.99423 MB/sec 1 clients 1 procs max_latency=255.822 ms 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stderr:+ dbench 10 2024-04-25T10:53:20.249 INFO:tasks.workunit.client.0.smithi016.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-04-25T10:53:20.250 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T10:53:20.250 INFO:tasks.workunit.client.0.smithi016.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-04-25T10:53:20.251 INFO:tasks.workunit.client.0.smithi016.stdout:9 of 10 processes prepared for launch 0 sec 2024-04-25T10:53:20.351 INFO:tasks.workunit.client.0.smithi016.stdout:10 of 10 processes prepared for launch 0 sec 2024-04-25T10:53:20.351 INFO:tasks.workunit.client.0.smithi016.stdout:releasing clients 2024-04-25T10:53:21.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225 86.99 MB/sec warmup 1 sec latency 63.766 ms 2024-04-25T10:53:22.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 404 71.57 MB/sec warmup 2 sec latency 95.823 ms 2024-04-25T10:53:23.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 842 71.82 MB/sec warmup 3 sec latency 53.063 ms 2024-04-25T10:53:24.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 1488 65.11 MB/sec warmup 4 sec latency 39.214 ms 2024-04-25T10:53:25.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 2428 56.16 MB/sec warmup 5 sec latency 37.543 ms 2024-04-25T10:53:26.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 3127 56.64 MB/sec warmup 6 sec latency 53.911 ms 2024-04-25T10:53:27.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 3646 54.83 MB/sec warmup 7 sec latency 78.429 ms 2024-04-25T10:53:28.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 3894 49.89 MB/sec warmup 8 sec latency 65.245 ms 2024-04-25T10:53:29.352 INFO:tasks.workunit.client.0.smithi016.stdout: 10 4013 44.51 MB/sec warmup 9 sec latency 77.070 ms 2024-04-25T10:53:30.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 4205 40.23 MB/sec warmup 10 sec latency 230.436 ms 2024-04-25T10:53:30.814 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:53:30.819 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:53:31.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 4559 37.55 MB/sec warmup 11 sec latency 205.068 ms 2024-04-25T10:53:32.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 5034 37.32 MB/sec warmup 12 sec latency 139.267 ms 2024-04-25T10:53:33.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 5852 36.06 MB/sec warmup 13 sec latency 82.532 ms 2024-04-25T10:53:34.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 6376 36.69 MB/sec warmup 14 sec latency 84.910 ms 2024-04-25T10:53:35.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 7095 38.09 MB/sec warmup 15 sec latency 39.210 ms 2024-04-25T10:53:36.353 INFO:tasks.workunit.client.0.smithi016.stdout: 10 7402 36.79 MB/sec warmup 16 sec latency 47.379 ms 2024-04-25T10:53:37.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 7546 34.79 MB/sec warmup 17 sec latency 115.303 ms 2024-04-25T10:53:38.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 7649 32.90 MB/sec warmup 18 sec latency 334.869 ms 2024-04-25T10:53:39.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 7833 31.34 MB/sec warmup 19 sec latency 289.946 ms 2024-04-25T10:53:40.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 8290 30.83 MB/sec warmup 20 sec latency 87.341 ms 2024-04-25T10:53:41.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 8994 30.74 MB/sec warmup 21 sec latency 61.996 ms 2024-04-25T10:53:42.356 INFO:tasks.workunit.client.0.smithi016.stdout: 10 9683 31.09 MB/sec warmup 22 sec latency 64.428 ms 2024-04-25T10:53:43.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 9988 30.84 MB/sec warmup 23 sec latency 408.099 ms 2024-04-25T10:53:44.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 9999 29.56 MB/sec warmup 24 sec latency 748.691 ms 2024-04-25T10:53:45.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 10388 29.44 MB/sec warmup 25 sec latency 732.245 ms 2024-04-25T10:53:46.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 10595 29.15 MB/sec warmup 26 sec latency 403.367 ms 2024-04-25T10:53:47.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 10829 28.65 MB/sec warmup 27 sec latency 78.429 ms 2024-04-25T10:53:48.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 11049 27.90 MB/sec warmup 28 sec latency 95.781 ms 2024-04-25T10:53:49.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 11249 27.03 MB/sec warmup 29 sec latency 100.566 ms 2024-04-25T10:53:50.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 11504 26.37 MB/sec warmup 30 sec latency 231.553 ms 2024-04-25T10:53:51.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 11901 26.25 MB/sec warmup 31 sec latency 98.676 ms 2024-04-25T10:53:52.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 12599 26.16 MB/sec warmup 32 sec latency 190.342 ms 2024-04-25T10:53:53.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 13231 26.58 MB/sec warmup 33 sec latency 66.987 ms 2024-04-25T10:53:54.360 INFO:tasks.workunit.client.0.smithi016.stdout: 10 13964 27.50 MB/sec warmup 34 sec latency 36.281 ms 2024-04-25T10:53:55.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 14349 27.45 MB/sec warmup 35 sec latency 77.010 ms 2024-04-25T10:53:56.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 14579 26.90 MB/sec warmup 36 sec latency 66.271 ms 2024-04-25T10:53:57.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 14813 26.35 MB/sec warmup 37 sec latency 188.198 ms 2024-04-25T10:53:58.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 15081 25.87 MB/sec warmup 38 sec latency 250.580 ms 2024-04-25T10:53:59.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 15679 26.18 MB/sec warmup 39 sec latency 59.062 ms 2024-04-25T10:54:00.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 16360 25.90 MB/sec warmup 40 sec latency 82.027 ms 2024-04-25T10:54:00.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:54:00.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:54:01.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 17057 26.70 MB/sec warmup 41 sec latency 37.917 ms 2024-04-25T10:54:02.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 17579 27.02 MB/sec warmup 42 sec latency 78.357 ms 2024-04-25T10:54:03.361 INFO:tasks.workunit.client.0.smithi016.stdout: 10 17874 26.75 MB/sec warmup 43 sec latency 68.487 ms 2024-04-25T10:54:04.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 18055 26.23 MB/sec warmup 44 sec latency 41.112 ms 2024-04-25T10:54:05.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 18254 25.79 MB/sec warmup 45 sec latency 206.679 ms 2024-04-25T10:54:06.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 18574 25.51 MB/sec warmup 46 sec latency 69.474 ms 2024-04-25T10:54:07.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 19060 25.44 MB/sec warmup 47 sec latency 73.268 ms 2024-04-25T10:54:08.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 19715 25.50 MB/sec warmup 48 sec latency 61.941 ms 2024-04-25T10:54:09.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 20425 25.74 MB/sec warmup 49 sec latency 43.776 ms 2024-04-25T10:54:10.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 20982 26.19 MB/sec warmup 50 sec latency 56.655 ms 2024-04-25T10:54:11.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 21416 26.28 MB/sec warmup 51 sec latency 37.212 ms 2024-04-25T10:54:12.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 21647 25.87 MB/sec warmup 52 sec latency 139.658 ms 2024-04-25T10:54:13.362 INFO:tasks.workunit.client.0.smithi016.stdout: 10 21952 25.62 MB/sec warmup 53 sec latency 95.022 ms 2024-04-25T10:54:14.363 INFO:tasks.workunit.client.0.smithi016.stdout: 10 22202 25.31 MB/sec warmup 54 sec latency 233.626 ms 2024-04-25T10:54:15.363 INFO:tasks.workunit.client.0.smithi016.stdout: 10 22554 25.15 MB/sec warmup 55 sec latency 380.739 ms 2024-04-25T10:54:16.363 INFO:tasks.workunit.client.0.smithi016.stdout: 10 22929 25.01 MB/sec warmup 56 sec latency 119.688 ms 2024-04-25T10:54:17.363 INFO:tasks.workunit.client.0.smithi016.stdout: 10 23522 25.13 MB/sec warmup 57 sec latency 52.516 ms 2024-04-25T10:54:18.363 INFO:tasks.workunit.client.0.smithi016.stdout: 10 24156 25.47 MB/sec warmup 58 sec latency 39.707 ms 2024-04-25T10:54:19.365 INFO:tasks.workunit.client.0.smithi016.stdout: 10 24572 25.47 MB/sec warmup 59 sec latency 99.114 ms 2024-04-25T10:54:20.365 INFO:tasks.workunit.client.0.smithi016.stdout: 10 24892 25.45 MB/sec warmup 60 sec latency 235.564 ms 2024-04-25T10:54:21.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 24972 25.11 MB/sec warmup 61 sec latency 405.983 ms 2024-04-25T10:54:22.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 25223 24.80 MB/sec warmup 62 sec latency 428.975 ms 2024-04-25T10:54:23.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 25517 24.57 MB/sec warmup 63 sec latency 74.047 ms 2024-04-25T10:54:24.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 25899 24.47 MB/sec warmup 64 sec latency 169.605 ms 2024-04-25T10:54:25.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 26087 24.20 MB/sec warmup 65 sec latency 458.696 ms 2024-04-25T10:54:26.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 26484 24.11 MB/sec warmup 66 sec latency 169.782 ms 2024-04-25T10:54:27.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 26977 24.17 MB/sec warmup 67 sec latency 106.484 ms 2024-04-25T10:54:28.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 27631 24.36 MB/sec warmup 68 sec latency 34.064 ms 2024-04-25T10:54:29.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 28153 24.56 MB/sec warmup 69 sec latency 81.249 ms 2024-04-25T10:54:30.366 INFO:tasks.workunit.client.0.smithi016.stdout: 10 28401 24.52 MB/sec warmup 70 sec latency 214.290 ms 2024-04-25T10:54:31.227 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:54:31.231 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:54:31.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 28564 24.28 MB/sec warmup 71 sec latency 154.942 ms 2024-04-25T10:54:32.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 28807 24.02 MB/sec warmup 72 sec latency 181.442 ms 2024-04-25T10:54:33.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 29210 23.92 MB/sec warmup 73 sec latency 68.367 ms 2024-04-25T10:54:34.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 29683 23.80 MB/sec warmup 74 sec latency 106.697 ms 2024-04-25T10:54:35.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 30085 23.84 MB/sec warmup 75 sec latency 288.345 ms 2024-04-25T10:54:36.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 30525 23.91 MB/sec warmup 76 sec latency 129.745 ms 2024-04-25T10:54:37.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 31161 24.01 MB/sec warmup 77 sec latency 69.049 ms 2024-04-25T10:54:38.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 31582 24.10 MB/sec warmup 78 sec latency 46.134 ms 2024-04-25T10:54:39.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 31939 24.11 MB/sec warmup 79 sec latency 132.107 ms 2024-04-25T10:54:40.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 32113 23.91 MB/sec warmup 80 sec latency 296.761 ms 2024-04-25T10:54:41.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 32309 23.70 MB/sec warmup 81 sec latency 84.279 ms 2024-04-25T10:54:42.367 INFO:tasks.workunit.client.0.smithi016.stdout: 10 32647 23.56 MB/sec warmup 82 sec latency 114.642 ms 2024-04-25T10:54:43.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 32993 23.42 MB/sec warmup 83 sec latency 200.529 ms 2024-04-25T10:54:44.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 33552 23.44 MB/sec warmup 84 sec latency 65.581 ms 2024-04-25T10:54:45.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 34100 23.66 MB/sec warmup 85 sec latency 166.489 ms 2024-04-25T10:54:46.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 34635 23.65 MB/sec warmup 86 sec latency 69.265 ms 2024-04-25T10:54:47.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 34866 23.61 MB/sec warmup 87 sec latency 242.686 ms 2024-04-25T10:54:48.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 35273 23.63 MB/sec warmup 88 sec latency 64.257 ms 2024-04-25T10:54:49.368 INFO:tasks.workunit.client.0.smithi016.stdout: 10 35584 23.59 MB/sec warmup 89 sec latency 130.925 ms 2024-04-25T10:54:50.369 INFO:tasks.workunit.client.0.smithi016.stdout: 10 35746 23.40 MB/sec warmup 90 sec latency 364.940 ms 2024-04-25T10:54:51.369 INFO:tasks.workunit.client.0.smithi016.stdout: 10 35814 23.16 MB/sec warmup 91 sec latency 468.043 ms 2024-04-25T10:54:52.369 INFO:tasks.workunit.client.0.smithi016.stdout: 10 36038 23.05 MB/sec warmup 92 sec latency 173.901 ms 2024-04-25T10:54:53.369 INFO:tasks.workunit.client.0.smithi016.stdout: 10 36415 22.92 MB/sec warmup 93 sec latency 50.316 ms 2024-04-25T10:54:54.369 INFO:tasks.workunit.client.0.smithi016.stdout: 10 36823 22.82 MB/sec warmup 94 sec latency 60.918 ms 2024-04-25T10:54:55.374 INFO:tasks.workunit.client.0.smithi016.stdout: 10 37496 23.11 MB/sec warmup 95 sec latency 40.873 ms 2024-04-25T10:54:56.375 INFO:tasks.workunit.client.0.smithi016.stdout: 10 37537 22.89 MB/sec warmup 96 sec latency 757.634 ms 2024-04-25T10:54:57.375 INFO:tasks.workunit.client.0.smithi016.stdout: 10 37573 22.66 MB/sec warmup 97 sec latency 873.821 ms 2024-04-25T10:54:58.376 INFO:tasks.workunit.client.0.smithi016.stdout: 10 38119 22.66 MB/sec warmup 98 sec latency 103.526 ms 2024-04-25T10:54:59.376 INFO:tasks.workunit.client.0.smithi016.stdout: 10 38356 22.61 MB/sec warmup 99 sec latency 87.548 ms 2024-04-25T10:55:00.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 38694 22.63 MB/sec warmup 100 sec latency 58.624 ms 2024-04-25T10:55:01.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 39077 22.65 MB/sec warmup 101 sec latency 95.483 ms 2024-04-25T10:55:01.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:55:01.562 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:55:02.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 39260 22.51 MB/sec warmup 102 sec latency 155.213 ms 2024-04-25T10:55:03.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 39597 22.43 MB/sec warmup 103 sec latency 62.692 ms 2024-04-25T10:55:04.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 40004 22.34 MB/sec warmup 104 sec latency 135.075 ms 2024-04-25T10:55:05.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 40466 22.29 MB/sec warmup 105 sec latency 73.048 ms 2024-04-25T10:55:06.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 41150 22.58 MB/sec warmup 106 sec latency 38.208 ms 2024-04-25T10:55:07.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 41752 22.62 MB/sec warmup 107 sec latency 72.860 ms 2024-04-25T10:55:08.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 42201 22.72 MB/sec warmup 108 sec latency 35.211 ms 2024-04-25T10:55:09.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 42603 22.72 MB/sec warmup 109 sec latency 109.976 ms 2024-04-25T10:55:10.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 42920 22.67 MB/sec warmup 110 sec latency 91.860 ms 2024-04-25T10:55:11.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 43384 22.61 MB/sec warmup 111 sec latency 56.384 ms 2024-04-25T10:55:12.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 43627 22.48 MB/sec warmup 112 sec latency 185.274 ms 2024-04-25T10:55:13.377 INFO:tasks.workunit.client.0.smithi016.stdout: 10 44148 22.50 MB/sec warmup 113 sec latency 52.524 ms 2024-04-25T10:55:14.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 44801 22.71 MB/sec warmup 114 sec latency 53.625 ms 2024-04-25T10:55:15.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 45353 22.71 MB/sec warmup 115 sec latency 74.066 ms 2024-04-25T10:55:16.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 45779 22.81 MB/sec warmup 116 sec latency 57.017 ms 2024-04-25T10:55:17.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 46085 22.76 MB/sec warmup 117 sec latency 177.306 ms 2024-04-25T10:55:18.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 46440 22.75 MB/sec warmup 118 sec latency 72.793 ms 2024-04-25T10:55:19.378 INFO:tasks.workunit.client.0.smithi016.stdout: 10 46824 22.65 MB/sec warmup 119 sec latency 80.934 ms 2024-04-25T10:55:21.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 47590 23.74 MB/sec execute 1 sec latency 152.016 ms 2024-04-25T10:55:22.386 INFO:tasks.workunit.client.0.smithi016.stdout: 10 47622 12.16 MB/sec execute 2 sec latency 659.572 ms 2024-04-25T10:55:23.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 48153 21.32 MB/sec execute 3 sec latency 204.892 ms 2024-04-25T10:55:24.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 48600 20.26 MB/sec execute 4 sec latency 59.658 ms 2024-04-25T10:55:25.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 49025 21.56 MB/sec execute 5 sec latency 75.683 ms 2024-04-25T10:55:26.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 49424 21.85 MB/sec execute 6 sec latency 143.857 ms 2024-04-25T10:55:27.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 49554 20.21 MB/sec execute 7 sec latency 613.769 ms 2024-04-25T10:55:28.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 49647 18.48 MB/sec execute 8 sec latency 823.175 ms 2024-04-25T10:55:29.388 INFO:tasks.workunit.client.0.smithi016.stdout: 10 49858 18.06 MB/sec execute 9 sec latency 98.302 ms 2024-04-25T10:55:30.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 50112 17.57 MB/sec execute 10 sec latency 69.527 ms 2024-04-25T10:55:31.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 50508 16.87 MB/sec execute 11 sec latency 117.974 ms 2024-04-25T10:55:31.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:55:31.954 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:55:31.966 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T10:55:31.965+0000 7febe9fad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32216) UID: 0 2024-04-25T10:55:31.966 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T10:55:31.965+0000 7fd3ae3ac640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32216) UID: 0 2024-04-25T10:55:31.966 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T10:55:31.965+0000 7f947a115640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32216) UID: 0 2024-04-25T10:55:32.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 50773 16.09 MB/sec execute 12 sec latency 126.331 ms 2024-04-25T10:55:33.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 51279 17.32 MB/sec execute 13 sec latency 49.725 ms 2024-04-25T10:55:34.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 51958 18.98 MB/sec execute 14 sec latency 46.176 ms 2024-04-25T10:55:35.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 52399 18.91 MB/sec execute 15 sec latency 116.508 ms 2024-04-25T10:55:36.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 52788 19.48 MB/sec execute 16 sec latency 132.645 ms 2024-04-25T10:55:37.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 53209 19.96 MB/sec execute 17 sec latency 70.037 ms 2024-04-25T10:55:38.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 53578 20.17 MB/sec execute 18 sec latency 106.145 ms 2024-04-25T10:55:39.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 53964 19.62 MB/sec execute 19 sec latency 145.089 ms 2024-04-25T10:55:40.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 54271 19.27 MB/sec execute 20 sec latency 119.172 ms 2024-04-25T10:55:41.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 54720 19.46 MB/sec execute 21 sec latency 75.590 ms 2024-04-25T10:55:42.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 55287 20.36 MB/sec execute 22 sec latency 88.998 ms 2024-04-25T10:55:43.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 55755 20.23 MB/sec execute 23 sec latency 96.417 ms 2024-04-25T10:55:44.389 INFO:tasks.workunit.client.0.smithi016.stdout: 10 56299 20.91 MB/sec execute 24 sec latency 35.013 ms 2024-04-25T10:55:45.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 56657 20.92 MB/sec execute 25 sec latency 85.160 ms 2024-04-25T10:55:46.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 56996 21.06 MB/sec execute 26 sec latency 96.658 ms 2024-04-25T10:55:47.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 57237 20.72 MB/sec execute 27 sec latency 373.686 ms 2024-04-25T10:55:48.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 57620 20.31 MB/sec execute 28 sec latency 413.566 ms 2024-04-25T10:55:49.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 57975 20.16 MB/sec execute 29 sec latency 138.756 ms 2024-04-25T10:55:50.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 58430 20.52 MB/sec execute 30 sec latency 117.329 ms 2024-04-25T10:55:51.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 58930 20.78 MB/sec execute 31 sec latency 105.544 ms 2024-04-25T10:55:52.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 59445 20.70 MB/sec execute 32 sec latency 80.033 ms 2024-04-25T10:55:53.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 59485 20.11 MB/sec execute 33 sec latency 650.926 ms 2024-04-25T10:55:54.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 59673 19.94 MB/sec execute 34 sec latency 600.152 ms 2024-04-25T10:55:55.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 59902 19.83 MB/sec execute 35 sec latency 104.470 ms 2024-04-25T10:55:56.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 60221 19.87 MB/sec execute 36 sec latency 121.101 ms 2024-04-25T10:55:57.390 INFO:tasks.workunit.client.0.smithi016.stdout: 10 60617 20.05 MB/sec execute 37 sec latency 82.805 ms 2024-04-25T10:55:58.391 INFO:tasks.workunit.client.0.smithi016.stdout: 10 60813 19.75 MB/sec execute 38 sec latency 433.274 ms 2024-04-25T10:55:59.391 INFO:tasks.workunit.client.0.smithi016.stdout: 10 60842 19.28 MB/sec execute 39 sec latency 790.096 ms 2024-04-25T10:56:00.391 INFO:tasks.workunit.client.0.smithi016.stdout: 10 61012 18.94 MB/sec execute 40 sec latency 195.810 ms 2024-04-25T10:56:01.391 INFO:tasks.workunit.client.0.smithi016.stdout: 10 61213 18.59 MB/sec execute 41 sec latency 112.604 ms 2024-04-25T10:56:02.391 INFO:tasks.workunit.client.0.smithi016.stdout: 10 61544 18.52 MB/sec execute 42 sec latency 92.815 ms 2024-04-25T10:56:03.392 INFO:tasks.workunit.client.0.smithi016.stdout: 10 61989 18.80 MB/sec execute 43 sec latency 129.381 ms 2024-04-25T10:56:04.392 INFO:tasks.workunit.client.0.smithi016.stdout: 10 62508 19.08 MB/sec execute 44 sec latency 51.207 ms 2024-04-25T10:56:05.392 INFO:tasks.workunit.client.0.smithi016.stdout: 10 63039 19.02 MB/sec execute 45 sec latency 85.104 ms 2024-04-25T10:56:06.392 INFO:tasks.workunit.client.0.smithi016.stdout: 10 63476 19.28 MB/sec execute 46 sec latency 152.032 ms 2024-04-25T10:56:07.393 INFO:tasks.workunit.client.0.smithi016.stdout: 10 63895 19.45 MB/sec execute 47 sec latency 74.783 ms 2024-04-25T10:56:08.393 INFO:tasks.workunit.client.0.smithi016.stdout: 10 64358 19.62 MB/sec execute 48 sec latency 65.851 ms 2024-04-25T10:56:09.393 INFO:tasks.workunit.client.0.smithi016.stdout: 10 64730 19.51 MB/sec execute 49 sec latency 82.283 ms 2024-04-25T10:56:10.393 INFO:tasks.workunit.client.0.smithi016.stdout: 10 65084 19.43 MB/sec execute 50 sec latency 125.445 ms 2024-04-25T10:56:11.393 INFO:tasks.workunit.client.0.smithi016.stdout: 10 65503 19.63 MB/sec execute 51 sec latency 102.510 ms 2024-04-25T10:56:12.394 INFO:tasks.workunit.client.0.smithi016.stdout: 10 65965 19.65 MB/sec execute 52 sec latency 81.249 ms 2024-04-25T10:56:13.394 INFO:tasks.workunit.client.0.smithi016.stdout: 10 66505 19.72 MB/sec execute 53 sec latency 85.438 ms 2024-04-25T10:56:14.395 INFO:tasks.workunit.client.0.smithi016.stdout: 10 66976 19.85 MB/sec execute 54 sec latency 93.973 ms 2024-04-25T10:56:15.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 67209 19.76 MB/sec execute 55 sec latency 489.496 ms 2024-04-25T10:56:16.395 INFO:tasks.workunit.client.0.smithi016.stdout: 10 67746 20.09 MB/sec execute 56 sec latency 82.354 ms 2024-04-25T10:56:17.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 67972 19.88 MB/sec execute 57 sec latency 245.113 ms 2024-04-25T10:56:18.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 68331 19.81 MB/sec execute 58 sec latency 86.325 ms 2024-04-25T10:56:19.399 INFO:tasks.workunit.client.0.smithi016.stdout: 10 68384 19.49 MB/sec execute 59 sec latency 506.501 ms 2024-04-25T10:56:20.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 68575 19.36 MB/sec execute 60 sec latency 714.495 ms 2024-04-25T10:56:21.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 68791 19.21 MB/sec execute 61 sec latency 93.663 ms 2024-04-25T10:56:22.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 69126 19.31 MB/sec execute 62 sec latency 87.006 ms 2024-04-25T10:56:23.396 INFO:tasks.workunit.client.0.smithi016.stdout: 10 69557 19.30 MB/sec execute 63 sec latency 115.784 ms 2024-04-25T10:56:24.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 69869 19.16 MB/sec execute 64 sec latency 429.357 ms 2024-04-25T10:56:25.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 70121 19.10 MB/sec execute 65 sec latency 544.585 ms 2024-04-25T10:56:26.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 70320 18.93 MB/sec execute 66 sec latency 136.380 ms 2024-04-25T10:56:27.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 70749 19.13 MB/sec execute 67 sec latency 122.779 ms 2024-04-25T10:56:28.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 71287 19.32 MB/sec execute 68 sec latency 53.311 ms 2024-04-25T10:56:29.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 71689 19.31 MB/sec execute 69 sec latency 86.154 ms 2024-04-25T10:56:30.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 72124 19.37 MB/sec execute 70 sec latency 50.783 ms 2024-04-25T10:56:31.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 72411 19.29 MB/sec execute 71 sec latency 173.365 ms 2024-04-25T10:56:32.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 72753 19.35 MB/sec execute 72 sec latency 149.213 ms 2024-04-25T10:56:33.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 73167 19.31 MB/sec execute 73 sec latency 73.464 ms 2024-04-25T10:56:34.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 73624 19.23 MB/sec execute 74 sec latency 105.524 ms 2024-04-25T10:56:35.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 74111 19.45 MB/sec execute 75 sec latency 104.878 ms 2024-04-25T10:56:36.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 74736 19.72 MB/sec execute 76 sec latency 56.553 ms 2024-04-25T10:56:37.397 INFO:tasks.workunit.client.0.smithi016.stdout: 10 75154 19.72 MB/sec execute 77 sec latency 58.825 ms 2024-04-25T10:56:38.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 75573 19.81 MB/sec execute 78 sec latency 51.341 ms 2024-04-25T10:56:39.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 75880 19.69 MB/sec execute 79 sec latency 107.937 ms 2024-04-25T10:56:40.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 76295 19.80 MB/sec execute 80 sec latency 54.410 ms 2024-04-25T10:56:41.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 76738 19.78 MB/sec execute 81 sec latency 77.321 ms 2024-04-25T10:56:42.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 77094 19.64 MB/sec execute 82 sec latency 114.137 ms 2024-04-25T10:56:43.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 77578 19.80 MB/sec execute 83 sec latency 58.960 ms 2024-04-25T10:56:44.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 78209 20.00 MB/sec execute 84 sec latency 39.767 ms 2024-04-25T10:56:45.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 78525 19.96 MB/sec execute 85 sec latency 216.974 ms 2024-04-25T10:56:46.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 78769 19.92 MB/sec execute 86 sec latency 255.793 ms 2024-04-25T10:56:47.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 78962 19.84 MB/sec execute 87 sec latency 472.629 ms 2024-04-25T10:56:48.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79202 19.75 MB/sec execute 88 sec latency 183.220 ms 2024-04-25T10:56:49.398 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79440 19.63 MB/sec execute 89 sec latency 448.665 ms 2024-04-25T10:56:50.400 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79614 19.53 MB/sec execute 90 sec latency 500.513 ms 2024-04-25T10:56:51.400 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79624 19.31 MB/sec execute 91 sec latency 933.391 ms 2024-04-25T10:56:52.400 INFO:tasks.workunit.client.0.smithi016.stdout: 10 79827 19.27 MB/sec execute 92 sec latency 1033.705 ms 2024-04-25T10:56:53.400 INFO:tasks.workunit.client.0.smithi016.stdout: 10 80060 19.17 MB/sec execute 93 sec latency 88.724 ms 2024-04-25T10:56:54.400 INFO:tasks.workunit.client.0.smithi016.stdout: 10 80413 19.10 MB/sec execute 94 sec latency 90.021 ms 2024-04-25T10:56:55.401 INFO:tasks.workunit.client.0.smithi016.stdout: 10 80671 18.98 MB/sec execute 95 sec latency 163.571 ms 2024-04-25T10:56:56.402 INFO:tasks.workunit.client.0.smithi016.stdout: 10 80803 18.87 MB/sec execute 96 sec latency 392.331 ms 2024-04-25T10:56:57.404 INFO:tasks.workunit.client.0.smithi016.stdout: 10 81180 18.96 MB/sec execute 97 sec latency 85.370 ms 2024-04-25T10:56:58.404 INFO:tasks.workunit.client.0.smithi016.stdout: 10 81687 19.12 MB/sec execute 98 sec latency 93.478 ms 2024-04-25T10:56:59.404 INFO:tasks.workunit.client.0.smithi016.stdout: 10 82155 19.13 MB/sec execute 99 sec latency 88.735 ms 2024-04-25T10:57:00.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 82481 19.11 MB/sec execute 100 sec latency 105.899 ms 2024-04-25T10:57:01.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 82882 19.19 MB/sec execute 101 sec latency 165.772 ms 2024-04-25T10:57:02.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 83244 19.16 MB/sec execute 102 sec latency 79.645 ms 2024-04-25T10:57:03.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 83694 19.19 MB/sec execute 103 sec latency 54.528 ms 2024-04-25T10:57:04.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 84165 19.19 MB/sec execute 104 sec latency 122.652 ms 2024-04-25T10:57:05.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 84581 19.23 MB/sec execute 105 sec latency 101.971 ms 2024-04-25T10:57:06.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 85177 19.42 MB/sec execute 106 sec latency 48.921 ms 2024-04-25T10:57:07.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 85570 19.44 MB/sec execute 107 sec latency 104.666 ms 2024-04-25T10:57:08.405 INFO:tasks.workunit.client.0.smithi016.stdout: 10 86011 19.48 MB/sec execute 108 sec latency 68.518 ms 2024-04-25T10:57:09.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 86388 19.49 MB/sec execute 109 sec latency 94.052 ms 2024-04-25T10:57:10.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 86773 19.51 MB/sec execute 110 sec latency 77.595 ms 2024-04-25T10:57:11.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 87243 19.52 MB/sec execute 111 sec latency 66.440 ms 2024-04-25T10:57:12.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 87664 19.51 MB/sec execute 112 sec latency 126.451 ms 2024-04-25T10:57:13.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 88189 19.63 MB/sec execute 113 sec latency 56.263 ms 2024-04-25T10:57:14.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 88659 19.72 MB/sec execute 114 sec latency 90.656 ms 2024-04-25T10:57:15.406 INFO:tasks.workunit.client.0.smithi016.stdout: 10 89108 19.74 MB/sec execute 115 sec latency 88.082 ms 2024-04-25T10:57:16.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 89337 19.67 MB/sec execute 116 sec latency 426.624 ms 2024-04-25T10:57:17.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 89352 19.52 MB/sec execute 117 sec latency 604.618 ms 2024-04-25T10:57:18.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 89608 19.45 MB/sec execute 118 sec latency 262.261 ms 2024-04-25T10:57:19.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 89836 19.40 MB/sec execute 119 sec latency 88.861 ms 2024-04-25T10:57:20.407 INFO:tasks.workunit.client.0.smithi016.stdout: 10 90167 19.39 MB/sec execute 120 sec latency 92.691 ms 2024-04-25T10:57:21.415 INFO:tasks.workunit.client.0.smithi016.stdout: 10 90601 19.41 MB/sec execute 121 sec latency 132.363 ms 2024-04-25T10:57:22.409 INFO:tasks.workunit.client.0.smithi016.stdout: 10 90621 19.25 MB/sec execute 122 sec latency 789.376 ms 2024-04-25T10:57:23.409 INFO:tasks.workunit.client.0.smithi016.stdout: 10 90929 19.21 MB/sec execute 123 sec latency 1004.743 ms 2024-04-25T10:57:24.409 INFO:tasks.workunit.client.0.smithi016.stdout: 10 91125 19.12 MB/sec execute 124 sec latency 181.595 ms 2024-04-25T10:57:25.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 91551 19.18 MB/sec execute 125 sec latency 82.201 ms 2024-04-25T10:57:26.409 INFO:tasks.workunit.client.0.smithi016.stdout: 10 92027 19.27 MB/sec execute 126 sec latency 84.465 ms 2024-04-25T10:57:27.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 92384 19.27 MB/sec execute 127 sec latency 132.323 ms 2024-04-25T10:57:28.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 92769 19.29 MB/sec execute 128 sec latency 105.266 ms 2024-04-25T10:57:29.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 93118 19.32 MB/sec execute 129 sec latency 136.058 ms 2024-04-25T10:57:30.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 93458 19.27 MB/sec execute 130 sec latency 160.297 ms 2024-04-25T10:57:31.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 93840 19.25 MB/sec execute 131 sec latency 109.616 ms 2024-04-25T10:57:32.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 94168 19.23 MB/sec execute 132 sec latency 145.370 ms 2024-04-25T10:57:33.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 94677 19.26 MB/sec execute 133 sec latency 71.713 ms 2024-04-25T10:57:34.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 95191 19.35 MB/sec execute 134 sec latency 81.980 ms 2024-04-25T10:57:35.410 INFO:tasks.workunit.client.0.smithi016.stdout: 10 95736 19.49 MB/sec execute 135 sec latency 41.130 ms 2024-04-25T10:57:36.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 96159 19.50 MB/sec execute 136 sec latency 108.571 ms 2024-04-25T10:57:37.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 96391 19.45 MB/sec execute 137 sec latency 112.633 ms 2024-04-25T10:57:38.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 96755 19.45 MB/sec execute 138 sec latency 82.616 ms 2024-04-25T10:57:39.413 INFO:tasks.workunit.client.0.smithi016.stdout: 10 97073 19.43 MB/sec execute 139 sec latency 163.593 ms 2024-04-25T10:57:40.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 97485 19.41 MB/sec execute 140 sec latency 103.960 ms 2024-04-25T10:57:41.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 98027 19.44 MB/sec execute 141 sec latency 123.029 ms 2024-04-25T10:57:42.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 98501 19.49 MB/sec execute 142 sec latency 104.832 ms 2024-04-25T10:57:43.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 99023 19.60 MB/sec execute 143 sec latency 69.275 ms 2024-04-25T10:57:44.411 INFO:tasks.workunit.client.0.smithi016.stdout: 10 99513 19.69 MB/sec execute 144 sec latency 72.509 ms 2024-04-25T10:57:45.413 INFO:tasks.workunit.client.0.smithi016.stdout: 10 99840 19.66 MB/sec execute 145 sec latency 112.930 ms 2024-04-25T10:57:46.413 INFO:tasks.workunit.client.0.smithi016.stdout: 10 100150 19.63 MB/sec execute 146 sec latency 98.718 ms 2024-04-25T10:57:47.414 INFO:tasks.workunit.client.0.smithi016.stdout: 10 100445 19.60 MB/sec execute 147 sec latency 230.865 ms 2024-04-25T10:57:48.415 INFO:tasks.workunit.client.0.smithi016.stdout: 10 100828 19.61 MB/sec execute 148 sec latency 92.134 ms 2024-04-25T10:57:49.415 INFO:tasks.workunit.client.0.smithi016.stdout: 10 101344 19.60 MB/sec execute 149 sec latency 93.422 ms 2024-04-25T10:57:50.415 INFO:tasks.workunit.client.0.smithi016.stdout: 10 101874 19.68 MB/sec execute 150 sec latency 81.940 ms 2024-04-25T10:57:51.415 INFO:tasks.workunit.client.0.smithi016.stdout: 10 102424 19.75 MB/sec execute 151 sec latency 138.814 ms 2024-04-25T10:57:52.426 INFO:tasks.workunit.client.0.smithi016.stdout: 10 102844 19.84 MB/sec execute 152 sec latency 187.261 ms 2024-04-25T10:57:53.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 102848 19.71 MB/sec execute 153 sec latency 1176.652 ms 2024-04-25T10:57:54.428 INFO:tasks.workunit.client.0.smithi016.stdout: 10 102854 19.59 MB/sec execute 154 sec latency 1659.393 ms 2024-04-25T10:57:55.428 INFO:tasks.workunit.client.0.smithi016.stdout: 10 102865 19.47 MB/sec execute 155 sec latency 1388.113 ms 2024-04-25T10:57:56.428 INFO:tasks.workunit.client.0.smithi016.stdout: 10 103052 19.40 MB/sec execute 156 sec latency 891.677 ms 2024-04-25T10:57:57.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 103284 19.34 MB/sec execute 157 sec latency 114.569 ms 2024-04-25T10:57:58.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 103463 19.28 MB/sec execute 158 sec latency 77.891 ms 2024-04-25T10:57:59.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 103641 19.22 MB/sec execute 159 sec latency 143.064 ms 2024-04-25T10:58:00.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 103890 19.17 MB/sec execute 160 sec latency 91.653 ms 2024-04-25T10:58:01.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 104176 19.12 MB/sec execute 161 sec latency 92.115 ms 2024-04-25T10:58:02.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 104400 19.08 MB/sec execute 162 sec latency 253.109 ms 2024-04-25T10:58:03.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 104875 19.11 MB/sec execute 163 sec latency 96.460 ms 2024-04-25T10:58:04.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 105499 19.17 MB/sec execute 164 sec latency 57.389 ms 2024-04-25T10:58:05.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 106039 19.28 MB/sec execute 165 sec latency 55.370 ms 2024-04-25T10:58:06.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 106478 19.38 MB/sec execute 166 sec latency 94.335 ms 2024-04-25T10:58:07.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 106878 19.35 MB/sec execute 167 sec latency 47.298 ms 2024-04-25T10:58:08.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 107109 19.29 MB/sec execute 168 sec latency 137.717 ms 2024-04-25T10:58:09.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 107453 19.27 MB/sec execute 169 sec latency 111.978 ms 2024-04-25T10:58:10.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 107918 19.31 MB/sec execute 170 sec latency 54.137 ms 2024-04-25T10:58:11.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 108409 19.31 MB/sec execute 171 sec latency 70.964 ms 2024-04-25T10:58:12.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 108964 19.38 MB/sec execute 172 sec latency 44.581 ms 2024-04-25T10:58:13.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 109349 19.39 MB/sec execute 173 sec latency 81.460 ms 2024-04-25T10:58:14.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 109909 19.52 MB/sec execute 174 sec latency 44.766 ms 2024-04-25T10:58:15.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 110294 19.51 MB/sec execute 175 sec latency 140.937 ms 2024-04-25T10:58:16.429 INFO:tasks.workunit.client.0.smithi016.stdout: 10 110631 19.51 MB/sec execute 176 sec latency 80.431 ms 2024-04-25T10:58:17.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 110911 19.46 MB/sec execute 177 sec latency 107.887 ms 2024-04-25T10:58:18.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 111275 19.47 MB/sec execute 178 sec latency 165.128 ms 2024-04-25T10:58:19.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 111670 19.46 MB/sec execute 179 sec latency 69.203 ms 2024-04-25T10:58:20.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 112062 19.43 MB/sec execute 180 sec latency 187.499 ms 2024-04-25T10:58:21.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 112578 19.51 MB/sec execute 181 sec latency 144.927 ms 2024-04-25T10:58:22.430 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113143 19.57 MB/sec execute 182 sec latency 84.962 ms 2024-04-25T10:58:23.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113445 19.60 MB/sec execute 183 sec latency 180.820 ms 2024-04-25T10:58:24.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113471 19.51 MB/sec execute 184 sec latency 792.949 ms 2024-04-25T10:58:25.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113501 19.42 MB/sec execute 185 sec latency 1096.112 ms 2024-04-25T10:58:26.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113759 19.36 MB/sec execute 186 sec latency 333.341 ms 2024-04-25T10:58:27.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 113998 19.33 MB/sec execute 187 sec latency 86.864 ms 2024-04-25T10:58:28.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 114236 19.29 MB/sec execute 188 sec latency 85.940 ms 2024-04-25T10:58:29.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 114326 19.21 MB/sec execute 189 sec latency 393.571 ms 2024-04-25T10:58:30.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 114562 19.15 MB/sec execute 190 sec latency 147.737 ms 2024-04-25T10:58:31.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 115022 19.19 MB/sec execute 191 sec latency 66.097 ms 2024-04-25T10:58:32.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 115494 19.19 MB/sec execute 192 sec latency 96.691 ms 2024-04-25T10:58:33.431 INFO:tasks.workunit.client.0.smithi016.stdout: 10 115969 19.23 MB/sec execute 193 sec latency 89.824 ms 2024-04-25T10:58:34.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 116505 19.30 MB/sec execute 194 sec latency 129.893 ms 2024-04-25T10:58:35.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 116993 19.37 MB/sec execute 195 sec latency 48.447 ms 2024-04-25T10:58:36.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 117339 19.36 MB/sec execute 196 sec latency 87.820 ms 2024-04-25T10:58:37.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 117715 19.36 MB/sec execute 197 sec latency 101.734 ms 2024-04-25T10:58:38.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 118028 19.33 MB/sec execute 198 sec latency 112.042 ms 2024-04-25T10:58:39.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 118436 19.36 MB/sec execute 199 sec latency 179.922 ms 2024-04-25T10:58:40.432 INFO:tasks.workunit.client.0.smithi016.stdout: 10 118923 19.37 MB/sec execute 200 sec latency 87.653 ms 2024-04-25T10:58:41.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 119478 19.41 MB/sec execute 201 sec latency 40.289 ms 2024-04-25T10:58:42.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 119858 19.44 MB/sec execute 202 sec latency 109.912 ms 2024-04-25T10:58:43.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 120461 19.53 MB/sec execute 203 sec latency 48.161 ms 2024-04-25T10:58:44.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 120802 19.50 MB/sec execute 204 sec latency 133.601 ms 2024-04-25T10:58:45.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 121232 19.53 MB/sec execute 205 sec latency 40.062 ms 2024-04-25T10:58:46.433 INFO:tasks.workunit.client.0.smithi016.stdout: 10 121542 19.51 MB/sec execute 206 sec latency 183.407 ms 2024-04-25T10:58:47.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 121996 19.54 MB/sec execute 207 sec latency 78.512 ms 2024-04-25T10:58:48.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 122499 19.54 MB/sec execute 208 sec latency 66.014 ms 2024-04-25T10:58:48.863 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:58:48.868 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:58:49.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 122983 19.57 MB/sec execute 209 sec latency 71.156 ms 2024-04-25T10:58:50.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 123416 19.61 MB/sec execute 210 sec latency 62.151 ms 2024-04-25T10:58:51.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 123937 19.68 MB/sec execute 211 sec latency 153.794 ms 2024-04-25T10:58:52.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 124217 19.64 MB/sec execute 212 sec latency 200.400 ms 2024-04-25T10:58:53.434 INFO:tasks.workunit.client.0.smithi016.stdout: 10 124625 19.63 MB/sec execute 213 sec latency 43.231 ms 2024-04-25T10:58:54.437 INFO:tasks.workunit.client.0.smithi016.stdout: 10 124816 19.58 MB/sec execute 214 sec latency 402.042 ms 2024-04-25T10:58:55.435 INFO:tasks.workunit.client.0.smithi016.stdout: 10 124840 19.49 MB/sec execute 215 sec latency 640.077 ms 2024-04-25T10:58:56.435 INFO:tasks.workunit.client.0.smithi016.stdout: 10 125144 19.48 MB/sec execute 216 sec latency 313.623 ms 2024-04-25T10:58:57.435 INFO:tasks.workunit.client.0.smithi016.stdout: 10 125443 19.48 MB/sec execute 217 sec latency 88.782 ms 2024-04-25T10:58:58.435 INFO:tasks.workunit.client.0.smithi016.stdout: 10 125885 19.51 MB/sec execute 218 sec latency 90.899 ms 2024-04-25T10:58:59.435 INFO:tasks.workunit.client.0.smithi016.stdout: 10 126377 19.50 MB/sec execute 219 sec latency 47.568 ms 2024-04-25T10:59:00.437 INFO:tasks.workunit.client.0.smithi016.stdout: 10 126448 19.44 MB/sec execute 220 sec latency 853.745 ms 2024-04-25T10:59:01.437 INFO:tasks.workunit.client.0.smithi016.stdout: 10 126463 19.35 MB/sec execute 221 sec latency 1100.195 ms 2024-04-25T10:59:02.437 INFO:tasks.workunit.client.0.smithi016.stdout: 10 126794 19.38 MB/sec execute 222 sec latency 123.408 ms 2024-04-25T10:59:03.438 INFO:tasks.workunit.client.0.smithi016.stdout: 10 127155 19.37 MB/sec execute 223 sec latency 82.388 ms 2024-04-25T10:59:04.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 127450 19.38 MB/sec execute 224 sec latency 88.391 ms 2024-04-25T10:59:05.439 INFO:tasks.workunit.client.0.smithi016.stdout: 10 127764 19.37 MB/sec execute 225 sec latency 85.506 ms 2024-04-25T10:59:06.439 INFO:tasks.workunit.client.0.smithi016.stdout: 10 128142 19.35 MB/sec execute 226 sec latency 91.156 ms 2024-04-25T10:59:07.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 128434 19.31 MB/sec execute 227 sec latency 148.030 ms 2024-04-25T10:59:08.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 128868 19.35 MB/sec execute 228 sec latency 95.718 ms 2024-04-25T10:59:09.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 129439 19.42 MB/sec execute 229 sec latency 37.486 ms 2024-04-25T10:59:10.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 129884 19.39 MB/sec execute 230 sec latency 76.900 ms 2024-04-25T10:59:11.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 130288 19.44 MB/sec execute 231 sec latency 70.565 ms 2024-04-25T10:59:12.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 130709 19.45 MB/sec execute 232 sec latency 135.755 ms 2024-04-25T10:59:13.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 131168 19.48 MB/sec execute 233 sec latency 43.877 ms 2024-04-25T10:59:14.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 131531 19.47 MB/sec execute 234 sec latency 109.177 ms 2024-04-25T10:59:15.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 131952 19.46 MB/sec execute 235 sec latency 119.704 ms 2024-04-25T10:59:16.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 132451 19.51 MB/sec execute 236 sec latency 42.990 ms 2024-04-25T10:59:17.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 132920 19.56 MB/sec execute 237 sec latency 97.412 ms 2024-04-25T10:59:18.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 133442 19.55 MB/sec execute 238 sec latency 67.814 ms 2024-04-25T10:59:19.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 133798 19.57 MB/sec execute 239 sec latency 89.394 ms 2024-04-25T10:59:20.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 134163 19.58 MB/sec execute 240 sec latency 127.336 ms 2024-04-25T10:59:21.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 134201 19.51 MB/sec execute 241 sec latency 905.377 ms 2024-04-25T10:59:22.182 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:59:22.186 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:59:22.347 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T10:59:22.349+0000 7febe9fad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32235) UID: 0 2024-04-25T10:59:22.348 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T10:59:22.349+0000 7f947a115640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32235) UID: 0 2024-04-25T10:59:22.348 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T10:59:22.349+0000 7fd3ae3ac640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32235) UID: 0 2024-04-25T10:59:22.440 INFO:tasks.workunit.client.0.smithi016.stdout: 10 134357 19.45 MB/sec execute 242 sec latency 1486.602 ms 2024-04-25T10:59:23.445 INFO:tasks.workunit.client.0.smithi016.stdout: 10 134610 19.44 MB/sec execute 243 sec latency 117.118 ms 2024-04-25T10:59:24.443 INFO:tasks.workunit.client.0.smithi016.stdout: 10 134855 19.42 MB/sec execute 244 sec latency 77.996 ms 2024-04-25T10:59:25.443 INFO:tasks.workunit.client.0.smithi016.stdout: 10 135098 19.38 MB/sec execute 245 sec latency 84.088 ms 2024-04-25T10:59:26.445 INFO:tasks.workunit.client.0.smithi016.stdout: 10 135238 19.33 MB/sec execute 246 sec latency 517.875 ms 2024-04-25T10:59:27.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 135497 19.29 MB/sec execute 247 sec latency 514.842 ms 2024-04-25T10:59:28.445 INFO:tasks.workunit.client.0.smithi016.stdout: 10 135675 19.25 MB/sec execute 248 sec latency 174.756 ms 2024-04-25T10:59:29.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 135890 19.23 MB/sec execute 249 sec latency 133.718 ms 2024-04-25T10:59:30.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 136415 19.28 MB/sec execute 250 sec latency 50.759 ms 2024-04-25T10:59:31.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 136901 19.29 MB/sec execute 251 sec latency 83.920 ms 2024-04-25T10:59:32.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 137203 19.27 MB/sec execute 252 sec latency 121.975 ms 2024-04-25T10:59:33.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 137615 19.31 MB/sec execute 253 sec latency 79.889 ms 2024-04-25T10:59:34.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 138060 19.35 MB/sec execute 254 sec latency 88.443 ms 2024-04-25T10:59:35.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 138364 19.32 MB/sec execute 255 sec latency 130.473 ms 2024-04-25T10:59:36.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 138748 19.31 MB/sec execute 256 sec latency 106.201 ms 2024-04-25T10:59:37.446 INFO:tasks.workunit.client.0.smithi016.stdout: 10 139089 19.30 MB/sec execute 257 sec latency 193.490 ms 2024-04-25T10:59:38.449 INFO:tasks.workunit.client.0.smithi016.stdout: 10 139579 19.34 MB/sec execute 258 sec latency 183.839 ms 2024-04-25T10:59:39.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 140041 19.37 MB/sec execute 259 sec latency 63.413 ms 2024-04-25T10:59:40.450 INFO:tasks.workunit.client.0.smithi016.stdout: 10 140461 19.35 MB/sec execute 260 sec latency 80.475 ms 2024-04-25T10:59:41.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 140938 19.39 MB/sec execute 261 sec latency 75.189 ms 2024-04-25T10:59:42.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 141366 19.42 MB/sec execute 262 sec latency 93.664 ms 2024-04-25T10:59:43.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 141783 19.43 MB/sec execute 263 sec latency 54.088 ms 2024-04-25T10:59:44.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 142122 19.42 MB/sec execute 264 sec latency 124.950 ms 2024-04-25T10:59:45.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 142429 19.40 MB/sec execute 265 sec latency 126.948 ms 2024-04-25T10:59:46.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 142817 19.41 MB/sec execute 266 sec latency 100.499 ms 2024-04-25T10:59:47.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 143395 19.45 MB/sec execute 267 sec latency 40.852 ms 2024-04-25T10:59:48.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 143789 19.45 MB/sec execute 268 sec latency 87.905 ms 2024-04-25T10:59:49.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 144275 19.47 MB/sec execute 269 sec latency 87.296 ms 2024-04-25T10:59:50.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 144691 19.51 MB/sec execute 270 sec latency 137.581 ms 2024-04-25T10:59:51.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 145118 19.53 MB/sec execute 271 sec latency 88.574 ms 2024-04-25T10:59:52.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 145490 19.54 MB/sec execute 272 sec latency 114.804 ms 2024-04-25T10:59:53.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 145858 19.51 MB/sec execute 273 sec latency 141.132 ms 2024-04-25T10:59:54.447 INFO:tasks.workunit.client.0.smithi016.stdout: 10 146155 19.50 MB/sec execute 274 sec latency 183.929 ms 2024-04-25T10:59:55.448 INFO:tasks.workunit.client.0.smithi016.stdout: 10 146539 19.52 MB/sec execute 275 sec latency 124.021 ms 2024-04-25T10:59:56.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 146977 19.51 MB/sec execute 276 sec latency 126.972 ms 2024-04-25T10:59:57.455 INFO:tasks.workunit.client.0.smithi016.stdout: 10 147013 19.45 MB/sec execute 277 sec latency 637.355 ms 2024-04-25T10:59:58.454 INFO:tasks.workunit.client.0.smithi016.stdout: 10 147201 19.41 MB/sec execute 278 sec latency 879.318 ms 2024-04-25T10:59:59.454 INFO:tasks.workunit.client.0.smithi016.stdout: 10 147380 19.37 MB/sec execute 279 sec latency 135.949 ms 2024-04-25T11:00:00.455 INFO:tasks.workunit.client.0.smithi016.stdout: 10 147677 19.36 MB/sec execute 280 sec latency 133.241 ms 2024-04-25T11:00:01.455 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148101 19.39 MB/sec execute 281 sec latency 79.853 ms 2024-04-25T11:00:02.464 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148269 19.37 MB/sec execute 282 sec latency 628.363 ms 2024-04-25T11:00:03.460 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148278 19.31 MB/sec execute 283 sec latency 954.361 ms 2024-04-25T11:00:04.460 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148411 19.26 MB/sec execute 284 sec latency 977.049 ms 2024-04-25T11:00:05.461 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148617 19.22 MB/sec execute 285 sec latency 112.690 ms 2024-04-25T11:00:06.461 INFO:tasks.workunit.client.0.smithi016.stdout: 10 148838 19.21 MB/sec execute 286 sec latency 99.094 ms 2024-04-25T11:00:07.461 INFO:tasks.workunit.client.0.smithi016.stdout: 10 149061 19.18 MB/sec execute 287 sec latency 127.596 ms 2024-04-25T11:00:08.461 INFO:tasks.workunit.client.0.smithi016.stdout: 10 149382 19.16 MB/sec execute 288 sec latency 190.601 ms 2024-04-25T11:00:09.461 INFO:tasks.workunit.client.0.smithi016.stdout: 10 149744 19.17 MB/sec execute 289 sec latency 114.656 ms 2024-04-25T11:00:10.468 INFO:tasks.workunit.client.0.smithi016.stdout: 10 150141 19.17 MB/sec execute 290 sec latency 131.546 ms 2024-04-25T11:00:11.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 150657 19.19 MB/sec execute 291 sec latency 84.126 ms 2024-04-25T11:00:12.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 151041 19.19 MB/sec execute 292 sec latency 102.686 ms 2024-04-25T11:00:13.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 151506 19.22 MB/sec execute 293 sec latency 69.478 ms 2024-04-25T11:00:14.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 151952 19.25 MB/sec execute 294 sec latency 111.708 ms 2024-04-25T11:00:15.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 152380 19.27 MB/sec execute 295 sec latency 126.521 ms 2024-04-25T11:00:16.465 INFO:tasks.workunit.client.0.smithi016.stdout: 10 152761 19.26 MB/sec execute 296 sec latency 78.674 ms 2024-04-25T11:00:17.467 INFO:tasks.workunit.client.0.smithi016.stdout: 10 153078 19.24 MB/sec execute 297 sec latency 89.681 ms 2024-04-25T11:00:18.467 INFO:tasks.workunit.client.0.smithi016.stdout: 10 153485 19.27 MB/sec execute 298 sec latency 94.820 ms 2024-04-25T11:00:19.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 153941 19.28 MB/sec execute 299 sec latency 95.553 ms 2024-04-25T11:00:20.468 INFO:tasks.workunit.client.0.smithi016.stdout: 10 154386 19.30 MB/sec execute 300 sec latency 53.420 ms 2024-04-25T11:00:21.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 154846 19.30 MB/sec execute 301 sec latency 77.375 ms 2024-04-25T11:00:22.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 155228 19.32 MB/sec execute 302 sec latency 203.445 ms 2024-04-25T11:00:23.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 155543 19.31 MB/sec execute 303 sec latency 353.846 ms 2024-04-25T11:00:24.466 INFO:tasks.workunit.client.0.smithi016.stdout: 10 156006 19.34 MB/sec execute 304 sec latency 50.024 ms 2024-04-25T11:00:25.467 INFO:tasks.workunit.client.0.smithi016.stdout: 10 156301 19.31 MB/sec execute 305 sec latency 113.940 ms 2024-04-25T11:00:26.470 INFO:tasks.workunit.client.0.smithi016.stdout: 10 156702 19.32 MB/sec execute 306 sec latency 65.794 ms 2024-04-25T11:00:27.469 INFO:tasks.workunit.client.0.smithi016.stdout: 10 157095 19.33 MB/sec execute 307 sec latency 88.203 ms 2024-04-25T11:00:28.470 INFO:tasks.workunit.client.0.smithi016.stdout: 10 157146 19.27 MB/sec execute 308 sec latency 670.425 ms 2024-04-25T11:00:29.470 INFO:tasks.workunit.client.0.smithi016.stdout: 10 157224 19.23 MB/sec execute 309 sec latency 1143.479 ms 2024-04-25T11:00:30.470 INFO:tasks.workunit.client.0.smithi016.stdout: 10 157409 19.19 MB/sec execute 310 sec latency 162.024 ms 2024-04-25T11:00:31.471 INFO:tasks.workunit.client.0.smithi016.stdout: 10 157638 19.17 MB/sec execute 311 sec latency 104.425 ms 2024-04-25T11:00:32.471 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158012 19.17 MB/sec execute 312 sec latency 70.465 ms 2024-04-25T11:00:33.484 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158260 19.15 MB/sec execute 313 sec latency 479.285 ms 2024-04-25T11:00:34.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158353 19.10 MB/sec execute 314 sec latency 799.935 ms 2024-04-25T11:00:35.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158597 19.09 MB/sec execute 315 sec latency 112.799 ms 2024-04-25T11:00:36.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 158791 19.06 MB/sec execute 316 sec latency 165.252 ms 2024-04-25T11:00:37.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 159142 19.07 MB/sec execute 317 sec latency 86.727 ms 2024-04-25T11:00:38.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 159584 19.10 MB/sec execute 318 sec latency 110.829 ms 2024-04-25T11:00:39.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 159890 19.07 MB/sec execute 319 sec latency 201.557 ms 2024-04-25T11:00:40.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 160255 19.08 MB/sec execute 320 sec latency 91.598 ms 2024-04-25T11:00:41.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 160659 19.08 MB/sec execute 321 sec latency 84.752 ms 2024-04-25T11:00:42.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 161016 19.09 MB/sec execute 322 sec latency 127.260 ms 2024-04-25T11:00:43.483 INFO:tasks.workunit.client.0.smithi016.stdout: 10 161460 19.10 MB/sec execute 323 sec latency 61.794 ms 2024-04-25T11:00:44.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 161858 19.10 MB/sec execute 324 sec latency 95.371 ms 2024-04-25T11:00:45.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 162242 19.10 MB/sec execute 325 sec latency 100.718 ms 2024-04-25T11:00:46.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 162654 19.12 MB/sec execute 326 sec latency 110.525 ms 2024-04-25T11:00:47.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 163119 19.15 MB/sec execute 327 sec latency 50.304 ms 2024-04-25T11:00:48.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 163446 19.13 MB/sec execute 328 sec latency 99.220 ms 2024-04-25T11:00:49.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 163887 19.17 MB/sec execute 329 sec latency 40.713 ms 2024-04-25T11:00:50.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 164267 19.15 MB/sec execute 330 sec latency 153.640 ms 2024-04-25T11:00:51.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 164616 19.15 MB/sec execute 331 sec latency 88.315 ms 2024-04-25T11:00:52.482 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165005 19.16 MB/sec execute 332 sec latency 127.755 ms 2024-04-25T11:00:53.483 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165493 19.18 MB/sec execute 333 sec latency 174.504 ms 2024-04-25T11:00:54.485 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165580 19.13 MB/sec execute 334 sec latency 636.122 ms 2024-04-25T11:00:55.485 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165590 19.08 MB/sec execute 335 sec latency 1472.501 ms 2024-04-25T11:00:56.486 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165695 19.03 MB/sec execute 336 sec latency 607.240 ms 2024-04-25T11:00:57.492 INFO:tasks.workunit.client.0.smithi016.stdout: 10 165979 19.02 MB/sec execute 337 sec latency 116.269 ms 2024-04-25T11:00:58.492 INFO:tasks.workunit.client.0.smithi016.stdout: 10 166245 19.01 MB/sec execute 338 sec latency 156.078 ms 2024-04-25T11:00:59.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 166442 19.00 MB/sec execute 339 sec latency 321.665 ms 2024-04-25T11:01:00.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 166708 18.98 MB/sec execute 340 sec latency 392.467 ms 2024-04-25T11:01:01.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 167055 18.97 MB/sec execute 341 sec latency 111.474 ms 2024-04-25T11:01:02.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 167315 18.96 MB/sec execute 342 sec latency 133.312 ms 2024-04-25T11:01:03.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 167666 18.96 MB/sec execute 343 sec latency 110.743 ms 2024-04-25T11:01:04.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 168012 18.97 MB/sec execute 344 sec latency 92.433 ms 2024-04-25T11:01:05.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 168443 18.98 MB/sec execute 345 sec latency 60.072 ms 2024-04-25T11:01:06.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 168809 18.97 MB/sec execute 346 sec latency 78.326 ms 2024-04-25T11:01:07.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 169132 18.96 MB/sec execute 347 sec latency 111.369 ms 2024-04-25T11:01:08.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 169543 18.97 MB/sec execute 348 sec latency 84.105 ms 2024-04-25T11:01:09.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 170048 19.00 MB/sec execute 349 sec latency 41.730 ms 2024-04-25T11:01:10.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 170481 19.00 MB/sec execute 350 sec latency 96.263 ms 2024-04-25T11:01:11.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 170910 19.02 MB/sec execute 351 sec latency 83.514 ms 2024-04-25T11:01:12.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 171331 19.03 MB/sec execute 352 sec latency 153.088 ms 2024-04-25T11:01:13.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 171703 19.05 MB/sec execute 353 sec latency 69.520 ms 2024-04-25T11:01:14.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 172113 19.05 MB/sec execute 354 sec latency 88.232 ms 2024-04-25T11:01:15.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 172518 19.06 MB/sec execute 355 sec latency 103.251 ms 2024-04-25T11:01:16.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 172899 19.07 MB/sec execute 356 sec latency 114.358 ms 2024-04-25T11:01:17.496 INFO:tasks.workunit.client.0.smithi016.stdout: 10 173293 19.06 MB/sec execute 357 sec latency 79.244 ms 2024-04-25T11:01:18.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 173747 19.07 MB/sec execute 358 sec latency 71.098 ms 2024-04-25T11:01:19.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 174306 19.11 MB/sec execute 359 sec latency 66.551 ms 2024-04-25T11:01:20.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 174643 19.10 MB/sec execute 360 sec latency 98.111 ms 2024-04-25T11:01:21.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 175072 19.12 MB/sec execute 361 sec latency 44.103 ms 2024-04-25T11:01:22.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 175486 19.14 MB/sec execute 362 sec latency 75.636 ms 2024-04-25T11:01:23.497 INFO:tasks.workunit.client.0.smithi016.stdout: 10 175799 19.13 MB/sec execute 363 sec latency 148.652 ms 2024-04-25T11:01:24.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176142 19.13 MB/sec execute 364 sec latency 120.613 ms 2024-04-25T11:01:25.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176259 19.09 MB/sec execute 365 sec latency 539.268 ms 2024-04-25T11:01:26.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176270 19.03 MB/sec execute 366 sec latency 1039.274 ms 2024-04-25T11:01:27.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176447 19.02 MB/sec execute 367 sec latency 548.572 ms 2024-04-25T11:01:28.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176637 19.00 MB/sec execute 368 sec latency 112.038 ms 2024-04-25T11:01:29.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 176939 18.97 MB/sec execute 369 sec latency 91.544 ms 2024-04-25T11:01:30.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 177181 18.95 MB/sec execute 370 sec latency 219.936 ms 2024-04-25T11:01:31.498 INFO:tasks.workunit.client.0.smithi016.stdout: 10 177195 18.90 MB/sec execute 371 sec latency 797.787 ms 2024-04-25T11:01:32.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 177506 18.90 MB/sec execute 372 sec latency 710.453 ms 2024-04-25T11:01:33.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 177814 18.90 MB/sec execute 373 sec latency 106.279 ms 2024-04-25T11:01:34.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 178060 18.88 MB/sec execute 374 sec latency 135.943 ms 2024-04-25T11:01:35.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 178497 18.90 MB/sec execute 375 sec latency 70.543 ms 2024-04-25T11:01:36.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 178872 18.92 MB/sec execute 376 sec latency 73.720 ms 2024-04-25T11:01:37.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 179324 18.93 MB/sec execute 377 sec latency 42.178 ms 2024-04-25T11:01:38.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 179545 18.90 MB/sec execute 378 sec latency 133.512 ms 2024-04-25T11:01:39.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 179935 18.90 MB/sec execute 379 sec latency 62.149 ms 2024-04-25T11:01:40.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 180291 18.91 MB/sec execute 380 sec latency 106.786 ms 2024-04-25T11:01:41.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 180749 18.91 MB/sec execute 381 sec latency 100.944 ms 2024-04-25T11:01:42.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 181297 18.94 MB/sec execute 382 sec latency 39.494 ms 2024-04-25T11:01:43.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 181628 18.93 MB/sec execute 383 sec latency 113.300 ms 2024-04-25T11:01:44.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 182054 18.95 MB/sec execute 384 sec latency 88.373 ms 2024-04-25T11:01:45.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 182526 18.99 MB/sec execute 385 sec latency 73.371 ms 2024-04-25T11:01:46.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 182899 18.98 MB/sec execute 386 sec latency 87.490 ms 2024-04-25T11:01:47.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 183163 18.96 MB/sec execute 387 sec latency 105.776 ms 2024-04-25T11:01:48.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 183430 18.95 MB/sec execute 388 sec latency 103.939 ms 2024-04-25T11:01:49.500 INFO:tasks.workunit.client.0.smithi016.stdout: 10 183851 18.97 MB/sec execute 389 sec latency 71.222 ms 2024-04-25T11:01:50.501 INFO:tasks.workunit.client.0.smithi016.stdout: 10 184173 18.96 MB/sec execute 390 sec latency 119.639 ms 2024-04-25T11:01:51.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 184346 18.92 MB/sec execute 391 sec latency 663.937 ms 2024-04-25T11:01:52.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 184400 18.89 MB/sec execute 392 sec latency 893.174 ms 2024-04-25T11:01:53.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 184765 18.88 MB/sec execute 393 sec latency 399.641 ms 2024-04-25T11:01:54.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185014 18.87 MB/sec execute 394 sec latency 120.447 ms 2024-04-25T11:01:55.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185350 18.87 MB/sec execute 395 sec latency 106.389 ms 2024-04-25T11:01:56.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185644 18.87 MB/sec execute 396 sec latency 296.263 ms 2024-04-25T11:01:57.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185667 18.83 MB/sec execute 397 sec latency 649.286 ms 2024-04-25T11:01:58.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 185966 18.84 MB/sec execute 398 sec latency 131.195 ms 2024-04-25T11:01:59.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 186198 18.82 MB/sec execute 399 sec latency 105.796 ms 2024-04-25T11:02:00.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 186537 18.80 MB/sec execute 400 sec latency 83.473 ms 2024-04-25T11:02:01.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 186870 18.80 MB/sec execute 401 sec latency 147.743 ms 2024-04-25T11:02:02.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 187310 18.82 MB/sec execute 402 sec latency 114.413 ms 2024-04-25T11:02:03.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 187722 18.83 MB/sec execute 403 sec latency 89.045 ms 2024-04-25T11:02:04.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 188310 18.84 MB/sec execute 404 sec latency 45.895 ms 2024-04-25T11:02:05.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 188742 18.86 MB/sec execute 405 sec latency 87.421 ms 2024-04-25T11:02:06.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 189140 18.86 MB/sec execute 406 sec latency 93.151 ms 2024-04-25T11:02:07.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 189555 18.90 MB/sec execute 407 sec latency 71.085 ms 2024-04-25T11:02:08.503 INFO:tasks.workunit.client.0.smithi016.stdout: 10 189852 18.89 MB/sec execute 408 sec latency 129.127 ms 2024-04-25T11:02:09.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 190169 18.86 MB/sec execute 409 sec latency 96.787 ms 2024-04-25T11:02:10.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 190445 18.86 MB/sec execute 410 sec latency 132.761 ms 2024-04-25T11:02:11.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 190813 18.85 MB/sec execute 411 sec latency 102.557 ms 2024-04-25T11:02:12.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 191196 18.87 MB/sec execute 412 sec latency 86.200 ms 2024-04-25T11:02:13.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 191651 18.87 MB/sec execute 413 sec latency 100.113 ms 2024-04-25T11:02:14.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 192113 18.89 MB/sec execute 414 sec latency 49.603 ms 2024-04-25T11:02:15.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 192554 18.89 MB/sec execute 415 sec latency 72.102 ms 2024-04-25T11:02:16.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 192967 18.93 MB/sec execute 416 sec latency 81.445 ms 2024-04-25T11:02:17.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 193338 18.93 MB/sec execute 417 sec latency 103.765 ms 2024-04-25T11:02:18.504 INFO:tasks.workunit.client.0.smithi016.stdout: 10 193662 18.91 MB/sec execute 418 sec latency 120.060 ms 2024-04-25T11:02:19.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 193922 18.90 MB/sec execute 419 sec latency 188.768 ms 2024-04-25T11:02:20.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 194293 18.90 MB/sec execute 420 sec latency 96.336 ms 2024-04-25T11:02:21.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 194790 18.92 MB/sec execute 421 sec latency 82.216 ms 2024-04-25T11:02:22.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 195173 18.92 MB/sec execute 422 sec latency 339.910 ms 2024-04-25T11:02:23.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 195198 18.88 MB/sec execute 423 sec latency 929.812 ms 2024-04-25T11:02:24.505 INFO:tasks.workunit.client.0.smithi016.stdout: 10 195500 18.87 MB/sec execute 424 sec latency 390.752 ms 2024-04-25T11:02:25.506 INFO:tasks.workunit.client.0.smithi016.stdout: 10 195821 18.86 MB/sec execute 425 sec latency 120.194 ms 2024-04-25T11:02:26.506 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196094 18.86 MB/sec execute 426 sec latency 98.109 ms 2024-04-25T11:02:27.508 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196314 18.85 MB/sec execute 427 sec latency 308.989 ms 2024-04-25T11:02:28.508 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196323 18.81 MB/sec execute 428 sec latency 1190.277 ms 2024-04-25T11:02:29.508 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196414 18.79 MB/sec execute 429 sec latency 1407.507 ms 2024-04-25T11:02:30.508 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196619 18.77 MB/sec execute 430 sec latency 110.605 ms 2024-04-25T11:02:31.509 INFO:tasks.workunit.client.0.smithi016.stdout: 10 196841 18.75 MB/sec execute 431 sec latency 94.774 ms 2024-04-25T11:02:32.510 INFO:tasks.workunit.client.0.smithi016.stdout: 10 197059 18.73 MB/sec execute 432 sec latency 106.929 ms 2024-04-25T11:02:33.509 INFO:tasks.workunit.client.0.smithi016.stdout: 10 197309 18.71 MB/sec execute 433 sec latency 239.122 ms 2024-04-25T11:02:34.509 INFO:tasks.workunit.client.0.smithi016.stdout: 10 197705 18.72 MB/sec execute 434 sec latency 90.665 ms 2024-04-25T11:02:35.509 INFO:tasks.workunit.client.0.smithi016.stdout: 10 198134 18.73 MB/sec execute 435 sec latency 116.358 ms 2024-04-25T11:02:36.510 INFO:tasks.workunit.client.0.smithi016.stdout: 10 198628 18.74 MB/sec execute 436 sec latency 84.162 ms 2024-04-25T11:02:37.510 INFO:tasks.workunit.client.0.smithi016.stdout: 10 198939 18.75 MB/sec execute 437 sec latency 117.323 ms 2024-04-25T11:02:38.510 INFO:tasks.workunit.client.0.smithi016.stdout: 10 199300 18.74 MB/sec execute 438 sec latency 113.075 ms 2024-04-25T11:02:39.511 INFO:tasks.workunit.client.0.smithi016.stdout: 10 199753 18.75 MB/sec execute 439 sec latency 116.782 ms 2024-04-25T11:02:40.512 INFO:tasks.workunit.client.0.smithi016.stdout: 10 200179 18.78 MB/sec execute 440 sec latency 96.767 ms 2024-04-25T11:02:41.512 INFO:tasks.workunit.client.0.smithi016.stdout: 10 200637 18.78 MB/sec execute 441 sec latency 137.692 ms 2024-04-25T11:02:42.512 INFO:tasks.workunit.client.0.smithi016.stdout: 10 200957 18.77 MB/sec execute 442 sec latency 90.143 ms 2024-04-25T11:02:43.513 INFO:tasks.workunit.client.0.smithi016.stdout: 10 201377 18.79 MB/sec execute 443 sec latency 82.490 ms 2024-04-25T11:02:44.512 INFO:tasks.workunit.client.0.smithi016.stdout: 10 201855 18.80 MB/sec execute 444 sec latency 55.060 ms 2024-04-25T11:02:45.513 INFO:tasks.workunit.client.0.smithi016.stdout: 10 202244 18.79 MB/sec execute 445 sec latency 104.324 ms 2024-04-25T11:02:46.513 INFO:tasks.workunit.client.0.smithi016.stdout: 10 202729 18.83 MB/sec execute 446 sec latency 50.847 ms 2024-04-25T11:02:47.514 INFO:tasks.workunit.client.0.smithi016.stdout: 10 203094 18.81 MB/sec execute 447 sec latency 178.854 ms 2024-04-25T11:02:48.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 203306 18.80 MB/sec execute 448 sec latency 508.122 ms 2024-04-25T11:02:49.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 203498 18.79 MB/sec execute 449 sec latency 629.621 ms 2024-04-25T11:02:50.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 203742 18.78 MB/sec execute 450 sec latency 94.179 ms 2024-04-25T11:02:51.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204045 18.77 MB/sec execute 451 sec latency 88.072 ms 2024-04-25T11:02:52.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204405 18.77 MB/sec execute 452 sec latency 100.229 ms 2024-04-25T11:02:53.517 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204630 18.75 MB/sec execute 453 sec latency 443.059 ms 2024-04-25T11:02:54.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204702 18.72 MB/sec execute 454 sec latency 1038.490 ms 2024-04-25T11:02:55.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 204975 18.71 MB/sec execute 455 sec latency 144.277 ms 2024-04-25T11:02:56.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 205255 18.71 MB/sec execute 456 sec latency 91.639 ms 2024-04-25T11:02:57.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 205530 18.70 MB/sec execute 457 sec latency 85.490 ms 2024-04-25T11:02:58.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 205958 18.71 MB/sec execute 458 sec latency 65.644 ms 2024-04-25T11:02:59.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 206399 18.72 MB/sec execute 459 sec latency 62.673 ms 2024-04-25T11:03:00.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 206713 18.71 MB/sec execute 460 sec latency 104.790 ms 2024-04-25T11:03:01.518 INFO:tasks.workunit.client.0.smithi016.stdout: 10 207204 18.74 MB/sec execute 461 sec latency 53.131 ms 2024-04-25T11:03:02.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 207562 18.73 MB/sec execute 462 sec latency 80.448 ms 2024-04-25T11:03:03.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 207957 18.73 MB/sec execute 463 sec latency 109.760 ms 2024-04-25T11:03:04.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 208334 18.74 MB/sec execute 464 sec latency 78.873 ms 2024-04-25T11:03:05.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 208843 18.77 MB/sec execute 465 sec latency 101.243 ms 2024-04-25T11:03:06.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209294 18.77 MB/sec execute 466 sec latency 69.516 ms 2024-04-25T11:03:07.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 209785 18.79 MB/sec execute 467 sec latency 38.468 ms 2024-04-25T11:03:08.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 210135 18.78 MB/sec execute 468 sec latency 190.356 ms 2024-04-25T11:03:09.471 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:03:09.475 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:03:09.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 210554 18.81 MB/sec execute 469 sec latency 82.533 ms 2024-04-25T11:03:09.520 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T11:03:09.521+0000 7febe9fad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32249) UID: 0 2024-04-25T11:03:09.520 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T11:03:09.521+0000 7fd3ae3ac640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32249) UID: 0 2024-04-25T11:03:09.520 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T11:03:09.521+0000 7f947a115640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32249) UID: 0 2024-04-25T11:03:10.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 210994 18.80 MB/sec execute 470 sec latency 42.409 ms 2024-04-25T11:03:11.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 211371 18.80 MB/sec execute 471 sec latency 98.143 ms 2024-04-25T11:03:12.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 211726 18.81 MB/sec execute 472 sec latency 124.610 ms 2024-04-25T11:03:13.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 212200 18.83 MB/sec execute 473 sec latency 75.183 ms 2024-04-25T11:03:14.519 INFO:tasks.workunit.client.0.smithi016.stdout: 10 212567 18.83 MB/sec execute 474 sec latency 173.166 ms 2024-04-25T11:03:15.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 212959 18.83 MB/sec execute 475 sec latency 106.727 ms 2024-04-25T11:03:16.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 213379 18.84 MB/sec execute 476 sec latency 47.388 ms 2024-04-25T11:03:17.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 213654 18.83 MB/sec execute 477 sec latency 214.087 ms 2024-04-25T11:03:18.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214086 18.84 MB/sec execute 478 sec latency 62.583 ms 2024-04-25T11:03:19.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214203 18.83 MB/sec execute 479 sec latency 688.545 ms 2024-04-25T11:03:20.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214215 18.79 MB/sec execute 480 sec latency 1247.726 ms 2024-04-25T11:03:21.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214317 18.76 MB/sec execute 481 sec latency 1253.940 ms 2024-04-25T11:03:22.520 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214528 18.73 MB/sec execute 482 sec latency 188.159 ms 2024-04-25T11:03:23.524 INFO:tasks.workunit.client.0.smithi016.stdout: 10 214846 18.72 MB/sec execute 483 sec latency 103.188 ms 2024-04-25T11:03:24.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 215088 18.70 MB/sec execute 484 sec latency 222.669 ms 2024-04-25T11:03:25.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 215119 18.67 MB/sec execute 485 sec latency 919.721 ms 2024-04-25T11:03:26.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 215251 18.65 MB/sec execute 486 sec latency 1093.052 ms 2024-04-25T11:03:27.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 215549 18.64 MB/sec execute 487 sec latency 85.489 ms 2024-04-25T11:03:28.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 215811 18.63 MB/sec execute 488 sec latency 184.215 ms 2024-04-25T11:03:29.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 216081 18.63 MB/sec execute 489 sec latency 107.873 ms 2024-04-25T11:03:30.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 216566 18.65 MB/sec execute 490 sec latency 66.937 ms 2024-04-25T11:03:31.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 216976 18.66 MB/sec execute 491 sec latency 81.574 ms 2024-04-25T11:03:32.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 217293 18.66 MB/sec execute 492 sec latency 153.763 ms 2024-04-25T11:03:33.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 217663 18.66 MB/sec execute 493 sec latency 92.969 ms 2024-04-25T11:03:34.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 217985 18.66 MB/sec execute 494 sec latency 88.178 ms 2024-04-25T11:03:35.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 218425 18.65 MB/sec execute 495 sec latency 117.069 ms 2024-04-25T11:03:36.531 INFO:tasks.workunit.client.0.smithi016.stdout: 10 218790 18.66 MB/sec execute 496 sec latency 85.769 ms 2024-04-25T11:03:37.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 219297 18.67 MB/sec execute 497 sec latency 106.907 ms 2024-04-25T11:03:38.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 219759 18.70 MB/sec execute 498 sec latency 140.719 ms 2024-04-25T11:03:39.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 220247 18.72 MB/sec execute 499 sec latency 48.190 ms 2024-04-25T11:03:40.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 220543 18.71 MB/sec execute 500 sec latency 100.417 ms 2024-04-25T11:03:41.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 220894 18.71 MB/sec execute 501 sec latency 174.207 ms 2024-04-25T11:03:42.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 221237 18.71 MB/sec execute 502 sec latency 83.664 ms 2024-04-25T11:03:43.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 221633 18.71 MB/sec execute 503 sec latency 76.225 ms 2024-04-25T11:03:44.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 222035 18.71 MB/sec execute 504 sec latency 74.147 ms 2024-04-25T11:03:45.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 222339 18.70 MB/sec execute 505 sec latency 273.488 ms 2024-04-25T11:03:46.534 INFO:tasks.workunit.client.0.smithi016.stdout: 10 222775 18.71 MB/sec execute 506 sec latency 72.419 ms 2024-04-25T11:03:47.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 223253 18.73 MB/sec execute 507 sec latency 117.528 ms 2024-04-25T11:03:48.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 223728 18.75 MB/sec execute 508 sec latency 59.447 ms 2024-04-25T11:03:49.532 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224074 18.75 MB/sec execute 509 sec latency 160.117 ms 2024-04-25T11:03:50.533 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224286 18.74 MB/sec execute 510 sec latency 354.466 ms 2024-04-25T11:03:51.533 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224293 18.70 MB/sec execute 511 sec latency 1132.064 ms 2024-04-25T11:03:52.533 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224346 18.67 MB/sec execute 512 sec latency 1540.833 ms 2024-04-25T11:03:53.533 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224551 18.65 MB/sec execute 513 sec latency 108.760 ms 2024-04-25T11:03:54.533 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224750 18.64 MB/sec execute 514 sec latency 114.965 ms 2024-04-25T11:03:55.580 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224933 18.63 MB/sec execute 515 sec latency 111.057 ms 2024-04-25T11:03:56.574 INFO:tasks.workunit.client.0.smithi016.stdout: 10 224962 18.59 MB/sec execute 516 sec latency 615.072 ms 2024-04-25T11:03:57.574 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225134 18.56 MB/sec execute 517 sec latency 350.148 ms 2024-04-25T11:03:58.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225310 18.54 MB/sec execute 518 sec latency 170.365 ms 2024-04-25T11:03:59.574 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225507 18.53 MB/sec execute 519 sec latency 184.851 ms 2024-04-25T11:04:00.574 INFO:tasks.workunit.client.0.smithi016.stdout: 10 225768 18.52 MB/sec execute 520 sec latency 128.197 ms 2024-04-25T11:04:01.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 226243 18.53 MB/sec execute 521 sec latency 95.031 ms 2024-04-25T11:04:02.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 226626 18.54 MB/sec execute 522 sec latency 124.560 ms 2024-04-25T11:04:03.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 227121 18.56 MB/sec execute 523 sec latency 73.031 ms 2024-04-25T11:04:04.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 227634 18.58 MB/sec execute 524 sec latency 38.078 ms 2024-04-25T11:04:05.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 227891 18.57 MB/sec execute 525 sec latency 120.629 ms 2024-04-25T11:04:06.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 228192 18.57 MB/sec execute 526 sec latency 109.995 ms 2024-04-25T11:04:07.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 228523 18.57 MB/sec execute 527 sec latency 100.634 ms 2024-04-25T11:04:08.578 INFO:tasks.workunit.client.0.smithi016.stdout: 10 228899 18.56 MB/sec execute 528 sec latency 128.050 ms 2024-04-25T11:04:09.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 229224 18.55 MB/sec execute 529 sec latency 128.045 ms 2024-04-25T11:04:10.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 229798 18.58 MB/sec execute 530 sec latency 60.299 ms 2024-04-25T11:04:11.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 230238 18.59 MB/sec execute 531 sec latency 112.821 ms 2024-04-25T11:04:12.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 230764 18.62 MB/sec execute 532 sec latency 42.502 ms 2024-04-25T11:04:13.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 231127 18.62 MB/sec execute 533 sec latency 149.417 ms 2024-04-25T11:04:14.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 231484 18.62 MB/sec execute 534 sec latency 239.716 ms 2024-04-25T11:04:15.575 INFO:tasks.workunit.client.0.smithi016.stdout: 10 231851 18.63 MB/sec execute 535 sec latency 92.792 ms 2024-04-25T11:04:16.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232100 18.62 MB/sec execute 536 sec latency 276.529 ms 2024-04-25T11:04:17.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232112 18.59 MB/sec execute 537 sec latency 1180.714 ms 2024-04-25T11:04:18.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232204 18.55 MB/sec execute 538 sec latency 1159.431 ms 2024-04-25T11:04:19.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232377 18.53 MB/sec execute 539 sec latency 164.906 ms 2024-04-25T11:04:20.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232540 18.51 MB/sec execute 540 sec latency 143.391 ms 2024-04-25T11:04:21.576 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232745 18.49 MB/sec execute 541 sec latency 122.289 ms 2024-04-25T11:04:22.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 232824 18.47 MB/sec execute 542 sec latency 558.154 ms 2024-04-25T11:04:23.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 233159 18.47 MB/sec execute 543 sec latency 131.354 ms 2024-04-25T11:04:24.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 233438 18.47 MB/sec execute 544 sec latency 122.198 ms 2024-04-25T11:04:25.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 233922 18.47 MB/sec execute 545 sec latency 60.029 ms 2024-04-25T11:04:26.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 234238 18.48 MB/sec execute 546 sec latency 155.519 ms 2024-04-25T11:04:27.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 234644 18.49 MB/sec execute 547 sec latency 84.896 ms 2024-04-25T11:04:28.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 234925 18.48 MB/sec execute 548 sec latency 124.924 ms 2024-04-25T11:04:29.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 235226 18.48 MB/sec execute 549 sec latency 112.259 ms 2024-04-25T11:04:30.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 235578 18.49 MB/sec execute 550 sec latency 83.771 ms 2024-04-25T11:04:31.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 235921 18.47 MB/sec execute 551 sec latency 112.331 ms 2024-04-25T11:04:32.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 236270 18.47 MB/sec execute 552 sec latency 88.870 ms 2024-04-25T11:04:33.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 236726 18.48 MB/sec execute 553 sec latency 85.759 ms 2024-04-25T11:04:34.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 237167 18.49 MB/sec execute 554 sec latency 102.500 ms 2024-04-25T11:04:35.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 237687 18.52 MB/sec execute 555 sec latency 60.644 ms 2024-04-25T11:04:36.577 INFO:tasks.workunit.client.0.smithi016.stdout: 10 238081 18.52 MB/sec execute 556 sec latency 106.617 ms 2024-04-25T11:04:37.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 238425 18.52 MB/sec execute 557 sec latency 130.133 ms 2024-04-25T11:04:38.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 238771 18.53 MB/sec execute 558 sec latency 68.123 ms 2024-04-25T11:04:39.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 239135 18.53 MB/sec execute 559 sec latency 80.254 ms 2024-04-25T11:04:40.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 239538 18.53 MB/sec execute 560 sec latency 114.311 ms 2024-04-25T11:04:41.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 239835 18.52 MB/sec execute 561 sec latency 186.496 ms 2024-04-25T11:04:42.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 240338 18.54 MB/sec execute 562 sec latency 54.300 ms 2024-04-25T11:04:43.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 240685 18.54 MB/sec execute 563 sec latency 180.698 ms 2024-04-25T11:04:44.581 INFO:tasks.workunit.client.0.smithi016.stdout: 10 241104 18.54 MB/sec execute 564 sec latency 125.269 ms 2024-04-25T11:04:45.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 241437 18.54 MB/sec execute 565 sec latency 124.597 ms 2024-04-25T11:04:46.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 241818 18.55 MB/sec execute 566 sec latency 91.819 ms 2024-04-25T11:04:47.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242077 18.54 MB/sec execute 567 sec latency 369.945 ms 2024-04-25T11:04:48.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242081 18.51 MB/sec execute 568 sec latency 1348.348 ms 2024-04-25T11:04:49.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242102 18.48 MB/sec execute 569 sec latency 1733.277 ms 2024-04-25T11:04:50.582 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242265 18.47 MB/sec execute 570 sec latency 347.555 ms 2024-04-25T11:04:51.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242454 18.45 MB/sec execute 571 sec latency 154.368 ms 2024-04-25T11:04:52.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242638 18.44 MB/sec execute 572 sec latency 152.299 ms 2024-04-25T11:04:53.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242691 18.41 MB/sec execute 573 sec latency 881.608 ms 2024-04-25T11:04:54.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 242832 18.39 MB/sec execute 574 sec latency 905.901 ms 2024-04-25T11:04:55.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 243006 18.37 MB/sec execute 575 sec latency 180.348 ms 2024-04-25T11:04:56.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 243156 18.35 MB/sec execute 576 sec latency 159.446 ms 2024-04-25T11:04:57.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 243441 18.34 MB/sec execute 577 sec latency 161.667 ms 2024-04-25T11:04:58.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 243811 18.35 MB/sec execute 578 sec latency 97.805 ms 2024-04-25T11:04:59.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 244255 18.36 MB/sec execute 579 sec latency 107.410 ms 2024-04-25T11:05:00.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 244714 18.36 MB/sec execute 580 sec latency 59.311 ms 2024-04-25T11:05:01.583 INFO:tasks.workunit.client.0.smithi016.stdout: 10 245082 18.37 MB/sec execute 581 sec latency 169.540 ms 2024-04-25T11:05:02.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 245453 18.38 MB/sec execute 582 sec latency 117.055 ms 2024-04-25T11:05:03.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 245811 18.38 MB/sec execute 583 sec latency 69.340 ms 2024-04-25T11:05:04.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 246189 18.39 MB/sec execute 584 sec latency 144.297 ms 2024-04-25T11:05:05.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 246495 18.38 MB/sec execute 585 sec latency 152.922 ms 2024-04-25T11:05:06.584 INFO:tasks.workunit.client.0.smithi016.stdout: 10 246859 18.37 MB/sec execute 586 sec latency 65.436 ms 2024-04-25T11:05:07.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 247242 18.38 MB/sec execute 587 sec latency 131.531 ms 2024-04-25T11:05:08.585 INFO:tasks.workunit.client.0.smithi016.stdout: 10 247717 18.39 MB/sec execute 588 sec latency 111.590 ms 2024-04-25T11:05:09.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 248126 18.40 MB/sec execute 589 sec latency 108.461 ms 2024-04-25T11:05:10.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 248506 18.40 MB/sec execute 590 sec latency 121.755 ms 2024-04-25T11:05:11.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 248820 18.40 MB/sec execute 591 sec latency 107.902 ms 2024-04-25T11:05:12.588 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249187 18.41 MB/sec execute 592 sec latency 124.133 ms 2024-04-25T11:05:13.594 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249372 18.39 MB/sec execute 593 sec latency 513.189 ms 2024-04-25T11:05:14.591 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249384 18.36 MB/sec execute 594 sec latency 1121.615 ms 2024-04-25T11:05:15.589 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249571 18.35 MB/sec execute 595 sec latency 783.103 ms 2024-04-25T11:05:16.590 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249767 18.34 MB/sec execute 596 sec latency 179.873 ms 2024-04-25T11:05:17.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 249908 18.32 MB/sec execute 597 sec latency 166.202 ms 2024-04-25T11:05:18.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 250186 18.31 MB/sec execute 598 sec latency 169.373 ms 2024-04-25T11:05:19.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 250298 18.29 MB/sec execute 599 sec latency 441.976 ms 2024-04-25T11:05:20.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 600 sec 2024-04-25T11:05:21.592 INFO:tasks.workunit.client.0.smithi016.stdout: 10 cleanup 601 sec 2024-04-25T11:05:22.592 INFO:tasks.workunit.client.0.smithi016.stdout: 8 cleanup 602 sec 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: 0 cleanup 603 sec 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: Operation Count AvgLat MaxLat 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: ---------------------------------------- 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: NTCreateX 351501 6.756 1644.777 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: Close 258172 0.005 3.585 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: Rename 14913 28.961 1733.263 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: Unlink 70965 12.418 1032.420 2024-04-25T11:05:23.247 INFO:tasks.workunit.client.0.smithi016.stdout: Qpathinfo 318723 4.913 1592.367 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: Qfileinfo 55623 0.002 1.903 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: Qfsinfo 58458 0.570 144.271 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: Sfileinfo 28666 0.871 1008.091 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: Find 123190 0.712 943.256 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: WriteX 173779 0.141 871.204 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: ReadX 552102 0.036 724.610 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: LockX 1148 10.090 240.571 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: UnlockX 1148 8.924 124.842 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: Flush 24660 21.376 1486.595 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout: 2024-04-25T11:05:23.248 INFO:tasks.workunit.client.0.smithi016.stdout:Throughput 18.2899 MB/sec 10 clients 10 procs max_latency=1733.277 ms 2024-04-25T11:05:23.257 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T11:05:23.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T11:05:25.346 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-04-25T11:05:25.346 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T11:05:26.172 DEBUG:teuthology.parallel:result is None 2024-04-25T11:05:26.173 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T11:05:26.218 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T11:05:26.219 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T11:05:26.230 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T11:05:26.230 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T11:05:26.230 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T11:05:26.274 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-25T11:05:26.274 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T11:05:26.332 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:05:27.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.045+0000 7f587da00640 1 Processor -- start 2024-04-25T11:05:27.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.045+0000 7f587da00640 1 -- start start 2024-04-25T11:05:27.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 0x7f5878155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58780c8a70 0x7f58780c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58780ca120 0x7f58780ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5878155640 con 0x7f58780c8a70 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f587815e5f0 con 0x7f587815b960 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f587da00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f587815e890 con 0x7f58780ca120 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58780c8a70 0x7f58780c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58780c8a70 0x7f58780c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49380/0 (socket says 172.21.15.16:49380) 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 -- 172.21.15.16:0/1185753820 learned_addr learned my addr 172.21.15.16:0/1185753820 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f5876a00640 1 --2- 172.21.15.16:0/1185753820 >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 0x7f5878155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f5877400640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58780ca120 0x7f58780ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 -- 172.21.15.16:0/1185753820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58780ca120 msgr2=0x7f58780ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58780ca120 0x7f58780ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 -- 172.21.15.16:0/1185753820 >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 msgr2=0x7f5878155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 --2- 172.21.15.16:0/1185753820 >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 0x7f5878155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f586fe00640 1 -- 172.21.15.16:0/1185753820 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587815eb70 con 0x7f58780c8a70 2024-04-25T11:05:27.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.049+0000 7f5876a00640 1 --2- 172.21.15.16:0/1185753820 >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 0x7f5878155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:27.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f586fe00640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58780c8e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58780ccd00 tx=0x7f586001ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751ad896969cf68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f5876000640 1 -- 172.21.15.16:0/1185753820 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600b5070 con 0x7f58780c8a70 2024-04-25T11:05:27.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f5876000640 1 -- 172.21.15.16:0/1185753820 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58600a8af0 con 0x7f58780c8a70 2024-04-25T11:05:27.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f5876000640 1 -- 172.21.15.16:0/1185753820 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600b0440 con 0x7f58780c8a70 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 -- 172.21.15.16:0/1185753820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 msgr2=0x7f58780c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58780c8e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58780ccd00 tx=0x7f586001ee30 comp rx=0 tx=0).stop 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 -- 172.21.15.16:0/1185753820 shutdown_connections 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f58780ca120 0x7f58780ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 --2- 172.21.15.16:0/1185753820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58780c8e80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 --2- 172.21.15.16:0/1185753820 >> v2:172.21.15.186:3300/0 conn(0x7f587815b960 0x7f5878155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 -- 172.21.15.16:0/1185753820 >> 172.21.15.16:0/1185753820 conn(0x7f5878073180 msgr2=0x7f5878073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:27.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 -- 172.21.15.16:0/1185753820 shutdown_connections 2024-04-25T11:05:27.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.053+0000 7f587da00640 1 -- 172.21.15.16:0/1185753820 wait complete. 2024-04-25T11:05:27.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 Processor -- start 2024-04-25T11:05:27.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- start start 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 0x7f587814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 0x7f5878148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f58780caa70 con 0x7f58780c8a70 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f587815f130 con 0x7f58780ca120 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f587815bd70 con 0x7f587815b960 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49392/0 (socket says 172.21.15.16:49392) 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 -- 172.21.15.16:0/13641856 learned_addr learned my addr 172.21.15.16:0/13641856 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5877400640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 0x7f5878148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f586fe00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 0x7f587814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 -- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 msgr2=0x7f5878148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 0x7f5878148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 -- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 msgr2=0x7f587814f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 0x7f587814f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 -- 172.21.15.16:0/13641856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780cd1c0 con 0x7f58780c8a70 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5877400640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 0x7f5878148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f586fe00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 0x7f587814f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:27.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f5876a00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f586800e840 tx=0x7f586800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868017070 con 0x7f58780c8a70 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58680098b0 con 0x7f58780c8a70 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587806d920 con 0x7f58780c8a70 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586800f040 con 0x7f58780c8a70 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.057+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781f8760 con 0x7f58780c8a70 2024-04-25T11:05:27.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.061+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5878050750 con 0x7f58780c8a70 2024-04-25T11:05:27.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.061+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f586801a070 con 0x7f58780c8a70 2024-04-25T11:05:27.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.061+0000 7f586ea00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 0x7f5850071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.061+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f586808f350 con 0x7f58780c8a70 2024-04-25T11:05:27.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.061+0000 7f586fe00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 0x7f5850071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.065+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f586805be80 con 0x7f58780c8a70 2024-04-25T11:05:27.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.153+0000 7f586fe00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 0x7f5850071ab0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58600b2000 tx=0x7f5860008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.240 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.237+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5878070230 con 0x7f58780c8a70 2024-04-25T11:05:27.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.237+0000 7f586ea00640 1 -- 172.21.15.16:0/13641856 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18891 (secure 0 0 0) 0x7f5868062e20 con 0x7f58780c8a70 2024-04-25T11:05:27.242 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:27.242 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:38.897256+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:05:27.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 msgr2=0x7f5850071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 0x7f5850071ab0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f58600b2000 tx=0x7f5860008040 comp rx=0 tx=0).stop 2024-04-25T11:05:27.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 msgr2=0x7f58781fc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.244 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f586800e840 tx=0x7f586800ed00 comp rx=0 tx=0).stop 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 shutdown_connections 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f585006f5a0 0x7f5850071ab0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f587815b960 0x7f5878148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f58780ca120 0x7f587814f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 --2- 172.21.15.16:0/13641856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58780c8a70 0x7f58781fc5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 >> 172.21.15.16:0/13641856 conn(0x7f5878073180 msgr2=0x7f587814c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 shutdown_connections 2024-04-25T11:05:27.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.241+0000 7f587da00640 1 -- 172.21.15.16:0/13641856 wait complete. 2024-04-25T11:05:27.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:38:45.700761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:38:56.312069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:38:57.697392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:39:01.362964+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T11:05:27.275 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T11:05:27.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 Processor -- start 2024-04-25T11:05:27.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 -- start start 2024-04-25T11:05:27.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99240c67e0 0x7f992415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992415e8b0 con 0x7f9924163800 2024-04-25T11:05:27.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992415eb90 con 0x7f992415bbe0 2024-04-25T11:05:27.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9929c00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f992415f430 con 0x7f99240c67e0 2024-04-25T11:05:27.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9923400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9924163800 0x7f9924165c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35756/0 (socket says 172.21.15.16:35756) 2024-04-25T11:05:27.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9922a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f99240c67e0 0x7f992415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9923400640 1 -- 172.21.15.16:0/3816062563 learned_addr learned my addr 172.21.15.16:0/3816062563 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:27.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9921600640 1 -- 172.21.15.16:0/3816062563 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633644071 0 0) 0x7f992415e8b0 con 0x7f9924163800 2024-04-25T11:05:27.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9921600640 1 -- 172.21.15.16:0/3816062563 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99080035c0 con 0x7f9924163800 2024-04-25T11:05:27.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9922a00640 1 -- 172.21.15.16:0/3816062563 >> v1:172.21.15.186:6789/0 conn(0x7f992415bbe0 legacy=0x7f99240cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9922a00640 1 -- 172.21.15.16:0/3816062563 >> v1:172.21.15.16:6789/0 conn(0x7f9924163800 legacy=0x7f9924165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.429+0000 7f9922a00640 1 -- 172.21.15.16:0/3816062563 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992415ee70 con 0x7f99240c67e0 2024-04-25T11:05:27.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9922a00640 1 --2- 172.21.15.16:0/3816062563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99240c67e0 0x7f992415b6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f991401ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713dcc755b7ef6de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9921600640 1 -- 172.21.15.16:0/3816062563 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99140b5070 con 0x7f99240c67e0 2024-04-25T11:05:27.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9921600640 1 -- 172.21.15.16:0/3816062563 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99140a8a90 con 0x7f99240c67e0 2024-04-25T11:05:27.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9921600640 1 -- 172.21.15.16:0/3816062563 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99140a8e40 con 0x7f99240c67e0 2024-04-25T11:05:27.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 -- 172.21.15.16:0/3816062563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99240c67e0 msgr2=0x7f992415b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 --2- 172.21.15.16:0/3816062563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99240c67e0 0x7f992415b6a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f991401ed90 comp rx=0 tx=0).stop 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 -- 172.21.15.16:0/3816062563 shutdown_connections 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 --2- 172.21.15.16:0/3816062563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f99240c67e0 0x7f992415b6a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 -- 172.21.15.16:0/3816062563 >> 172.21.15.16:0/3816062563 conn(0x7f99240732e0 msgr2=0x7f99240736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 -- 172.21.15.16:0/3816062563 shutdown_connections 2024-04-25T11:05:27.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.433+0000 7f9929c00640 1 -- 172.21.15.16:0/3816062563 wait complete. 2024-04-25T11:05:27.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 Processor -- start 2024-04-25T11:05:27.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 -- start start 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 0x7f992406f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f992415bbe0 0x7f9924150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f992415e4e0 con 0x7f9924163800 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f992415b180 con 0x7f992415bbe0 2024-04-25T11:05:27.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9929c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f992415e660 con 0x7f99240c67e0 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9922a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 0x7f992406f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9923400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9922a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 0x7f992406f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46676/0 (socket says 172.21.15.16:46676) 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9923400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49406/0 (socket says 172.21.15.16:49406) 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9922a00640 1 -- 172.21.15.16:0/3762694796 learned_addr learned my addr 172.21.15.16:0/3762694796 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:27.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.437+0000 7f9922000640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f992415bbe0 0x7f9924150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 -- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 msgr2=0x7f992406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 0x7f992406f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 -- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f992415bbe0 msgr2=0x7f9924150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f992415bbe0 0x7f9924150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 -- 172.21.15.16:0/3762694796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992414ef50 con 0x7f9924163800 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9923400640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99240b4f50 tx=0x7f991c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c017070 con 0x7f9924163800 2024-04-25T11:05:27.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c00ac70 con 0x7f9924163800 2024-04-25T11:05:27.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992414f230 con 0x7f9924163800 2024-04-25T11:05:27.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c012640 con 0x7f9924163800 2024-04-25T11:05:27.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241558e0 con 0x7f9924163800 2024-04-25T11:05:27.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99240c6ee0 con 0x7f9924163800 2024-04-25T11:05:27.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.441+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f991c01a070 con 0x7f9924163800 2024-04-25T11:05:27.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.445+0000 7f991aa00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 0x7f98fc071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.445+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f991c08f260 con 0x7f9924163800 2024-04-25T11:05:27.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.445+0000 7f9922a00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 0x7f98fc071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.445+0000 7f9922a00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 0x7f98fc071ab0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f9914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.449+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f991c00ae20 con 0x7f9924163800 2024-04-25T11:05:27.673 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.669+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f992406eee0 con 0x7f9924163800 2024-04-25T11:05:27.674 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.669+0000 7f991aa00640 1 -- 172.21.15.16:0/3762694796 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f991c05b710 con 0x7f9924163800 2024-04-25T11:05:27.674 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 msgr2=0x7f98fc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 0x7f98fc071ab0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f9914009040 comp rx=0 tx=0).stop 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 msgr2=0x7f992414df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f99240b4f50 tx=0x7f991c00a060 comp rx=0 tx=0).stop 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 shutdown_connections 2024-04-25T11:05:27.676 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f98fc06f5a0 0x7f98fc071ab0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9924163800 0x7f992414df80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f992415bbe0 0x7f9924150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 --2- 172.21.15.16:0/3762694796 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f99240c67e0 0x7f992406f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 >> 172.21.15.16:0/3762694796 conn(0x7f99240732e0 msgr2=0x7f99240c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 shutdown_connections 2024-04-25T11:05:27.677 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.673+0000 7f9929c00640 1 -- 172.21.15.16:0/3762694796 wait complete. 2024-04-25T11:05:27.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T11:05:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 Processor -- start 2024-04-25T11:05:27.852 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 -- start start 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bf015e8b0 con 0x7f5bf00c67e0 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bf015eb90 con 0x7f5bf0163800 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bf5c00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf015f430 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bee000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5beea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5bf00c67e0 0x7f5bf015b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35772/0 (socket says 172.21.15.16:35772) 2024-04-25T11:05:27.854 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5beea00640 1 -- 172.21.15.16:0/3669053601 learned_addr learned my addr 172.21.15.16:0/3669053601 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.849+0000 7f5bee000640 1 --2- 172.21.15.16:0/3669053601 >> v2:172.21.15.16:3300/0 conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49414/0 (socket says 172.21.15.16:49414) 2024-04-25T11:05:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bee000640 1 -- 172.21.15.16:0/3669053601 >> v1:172.21.15.186:6789/0 conn(0x7f5bf0163800 legacy=0x7f5bf0165c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bee000640 1 -- 172.21.15.16:0/3669053601 >> v1:172.21.15.16:6789/0 conn(0x7f5bf00c67e0 legacy=0x7f5bf015b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bee000640 1 -- 172.21.15.16:0/3669053601 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf015ee70 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bee000640 1 --2- 172.21.15.16:0/3669053601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009900 tx=0x7f5bdc01ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb47f71a96435e2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bed600640 1 -- 172.21.15.16:0/3669053601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0b5070 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bed600640 1 -- 172.21.15.16:0/3669053601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bdc0a8a90 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.853+0000 7f5bed600640 1 -- 172.21.15.16:0/3669053601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc0b0440 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- 172.21.15.16:0/3669053601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00cc1c0 msgr2=0x7f5bf00cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/3669053601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009900 tx=0x7f5bdc01ed90 comp rx=0 tx=0).stop 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- 172.21.15.16:0/3669053601 shutdown_connections 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/3669053601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf00cc5d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- 172.21.15.16:0/3669053601 >> 172.21.15.16:0/3669053601 conn(0x7f5bf00732e0 msgr2=0x7f5bf00736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- 172.21.15.16:0/3669053601 shutdown_connections 2024-04-25T11:05:27.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- 172.21.15.16:0/3669053601 wait complete. 2024-04-25T11:05:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 Processor -- start 2024-04-25T11:05:27.861 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.857+0000 7f5bf5c00640 1 -- start start 2024-04-25T11:05:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf0149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bf0163800 0x7f5bf01ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.863 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf015bdb0 con 0x7f5bf00c67e0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf015b180 con 0x7f5bf00cc1c0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf015bf30 con 0x7f5bf0163800 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49418/0 (socket says 172.21.15.16:49418) 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 -- 172.21.15.16:0/2148282636 learned_addr learned my addr 172.21.15.16:0/2148282636 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bee000640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf0149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bef400640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bf0163800 0x7f5bf01ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 -- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bf0163800 msgr2=0x7f5bf01ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bf0163800 0x7f5bf01ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 -- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bf00cc1c0 msgr2=0x7f5bf0149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf0149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 -- 172.21.15.16:0/2148282636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf006e7a0 con 0x7f5bf00c67e0 2024-04-25T11:05:27.864 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5beea00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5be00058d0 tx=0x7f5be000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0005d30 con 0x7f5bf00c67e0 2024-04-25T11:05:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0007070 con 0x7f5bf00c67e0 2024-04-25T11:05:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0007460 con 0x7f5bf00c67e0 2024-04-25T11:05:27.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf014a2f0 con 0x7f5bf00c67e0 2024-04-25T11:05:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf01fcc90 con 0x7f5bf00c67e0 2024-04-25T11:05:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.861+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf01596d0 con 0x7f5bf00c67e0 2024-04-25T11:05:27.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.865+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5be001b400 con 0x7f5bf00c67e0 2024-04-25T11:05:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.865+0000 7f5be6a00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 0x7f5bc8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.865+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5be008f340 con 0x7f5bf00c67e0 2024-04-25T11:05:27.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.865+0000 7f5bee000640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 0x7f5bc8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:27.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.865+0000 7f5bee000640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 0x7f5bc8071ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0b2000 tx=0x7f5bdc0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:27.871 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:27.869+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5be005bde0 con 0x7f5bf00c67e0 2024-04-25T11:05:28.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.033+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5bf015da40 con 0x7f5bf00c67e0 2024-04-25T11:05:28.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.033+0000 7f5be6a00640 1 -- 172.21.15.16:0/2148282636 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f5be005b6e0 con 0x7f5bf00c67e0 2024-04-25T11:05:28.038 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T11:05:28.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 msgr2=0x7f5bc8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 0x7f5bc8071ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0b2000 tx=0x7f5bdc0aa070 comp rx=0 tx=0).stop 2024-04-25T11:05:28.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 msgr2=0x7f5bf006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5be00058d0 tx=0x7f5be000ca20 comp rx=0 tx=0).stop 2024-04-25T11:05:28.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 shutdown_connections 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f5bc806f5a0 0x7f5bc8071ab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bf0163800 0x7f5bf01ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bf00cc1c0 0x7f5bf0149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 --2- 172.21.15.16:0/2148282636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bf00c67e0 0x7f5bf006e260 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 >> 172.21.15.16:0/2148282636 conn(0x7f5bf00732e0 msgr2=0x7f5bf015a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 shutdown_connections 2024-04-25T11:05:28.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.037+0000 7f5bf5c00640 1 -- 172.21.15.16:0/2148282636 wait complete. 2024-04-25T11:05:28.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T11:05:28.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 Processor -- start 2024-04-25T11:05:28.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 -- start start 2024-04-25T11:05:28.218 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb80c15df50 0x7fb80c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb80c0c30c0 0x7fb80c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c15d4b0 con 0x7fb80c0c4af0 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb80c15e360 con 0x7fb80c15df50 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb812a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb80c15dac0 con 0x7fb80c0c30c0 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.213+0000 7fb80be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb80c15df50 0x7fb80c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb80c15df50 0x7fb80c159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49428/0 (socket says 172.21.15.16:49428) 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 -- 172.21.15.16:0/830233910 learned_addr learned my addr 172.21.15.16:0/830233910 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb803e00640 1 --2- 172.21.15.16:0/830233910 >> v2:172.21.15.186:3300/0 conn(0x7fb80c0c30c0 0x7fb80c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 -- 172.21.15.16:0/830233910 >> v2:172.21.15.186:3300/0 conn(0x7fb80c0c30c0 msgr2=0x7fb80c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 --2- 172.21.15.16:0/830233910 >> v2:172.21.15.186:3300/0 conn(0x7fb80c0c30c0 0x7fb80c0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 -- 172.21.15.16:0/830233910 >> v1:172.21.15.16:6789/0 conn(0x7fb80c0c4af0 legacy=0x7fb80c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 -- 172.21.15.16:0/830233910 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c0c57c0 con 0x7fb80c15df50 2024-04-25T11:05:28.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80be00640 1 --2- 172.21.15.16:0/830233910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c15df50 0x7fb80c159ea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0c1310 tx=0x7fb7fc01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b17d65d0797f883 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80b400640 1 -- 172.21.15.16:0/830233910 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0a9610 con 0x7fb80c15df50 2024-04-25T11:05:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80b400640 1 -- 172.21.15.16:0/830233910 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc0a97b0 con 0x7fb80c15df50 2024-04-25T11:05:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.217+0000 7fb80b400640 1 -- 172.21.15.16:0/830233910 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc0a9bc0 con 0x7fb80c15df50 2024-04-25T11:05:28.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- 172.21.15.16:0/830233910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c15df50 msgr2=0x7fb80c159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 --2- 172.21.15.16:0/830233910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c15df50 0x7fb80c159ea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0c1310 tx=0x7fb7fc01c640 comp rx=0 tx=0).stop 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- 172.21.15.16:0/830233910 shutdown_connections 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 --2- 172.21.15.16:0/830233910 >> v2:172.21.15.186:3300/0 conn(0x7fb80c0c30c0 0x7fb80c0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 --2- 172.21.15.16:0/830233910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c15df50 0x7fb80c159ea0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- 172.21.15.16:0/830233910 >> 172.21.15.16:0/830233910 conn(0x7fb80c074930 msgr2=0x7fb80c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- 172.21.15.16:0/830233910 shutdown_connections 2024-04-25T11:05:28.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- 172.21.15.16:0/830233910 wait complete. 2024-04-25T11:05:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 Processor -- start 2024-04-25T11:05:28.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.221+0000 7fb812a00640 1 -- start start 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0c30c0 0x7fb80c151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15df50 0x7fb80c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c0c3650 con 0x7fb80c0c4af0 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c0c34d0 con 0x7fb80c15df50 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c0cd860 con 0x7fb80c0c30c0 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49434/0 (socket says 172.21.15.16:49434) 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 -- 172.21.15.16:0/1613047289 learned_addr learned my addr 172.21.15.16:0/1613047289 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb80be00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0c30c0 0x7fb80c151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb810a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15df50 0x7fb80c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 -- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0c30c0 msgr2=0x7fb80c151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0c30c0 0x7fb80c151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 -- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15df50 msgr2=0x7fb80c152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15df50 0x7fb80c152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 -- 172.21.15.16:0/1613047289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c1f9590 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb803e00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400d840 tx=0x7fb7f400dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400de30 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f4019070 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c151b90 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400baf0 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c15b460 con 0x7fb80c0c4af0 2024-04-25T11:05:28.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.225+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80c151920 con 0x7fb80c0c4af0 2024-04-25T11:05:28.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.229+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb7f400bd10 con 0x7fb80c0c4af0 2024-04-25T11:05:28.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.229+0000 7fb808c00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 0x7fb7e4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.229+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb7f408fc10 con 0x7fb80c0c4af0 2024-04-25T11:05:28.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.229+0000 7fb80be00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 0x7fb7e4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.229+0000 7fb80be00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 0x7fb7e4071ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0ae000 tx=0x7fb7fc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.245 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.241+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb7f405c740 con 0x7fb80c0c4af0 2024-04-25T11:05:28.411 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb80c0c92e0 con 0x7fb80c0c4af0 2024-04-25T11:05:28.412 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb808c00640 1 -- 172.21.15.16:0/1613047289 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fb7f405c040 con 0x7fb80c0c4af0 2024-04-25T11:05:28.412 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2024-04-25T11:05:28.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 msgr2=0x7fb7e4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 0x7fb7e4071ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0ae000 tx=0x7fb7fc0a7000 comp rx=0 tx=0).stop 2024-04-25T11:05:28.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 msgr2=0x7fb80c15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400d840 tx=0x7fb7f400dd00 comp rx=0 tx=0).stop 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 shutdown_connections 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb7e406f5a0 0x7fb7e4071ab0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb80c15df50 0x7fb80c152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb80c0c4af0 0x7fb80c15caa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 --2- 172.21.15.16:0/1613047289 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb80c0c30c0 0x7fb80c151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 >> 172.21.15.16:0/1613047289 conn(0x7fb80c074930 msgr2=0x7fb80c14f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.409+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 shutdown_connections 2024-04-25T11:05:28.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.413+0000 7fb812a00640 1 -- 172.21.15.16:0/1613047289 wait complete. 2024-04-25T11:05:28.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T11:05:28.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 Processor -- start 2024-04-25T11:05:28.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 -- start start 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f10a00c94f0 0x7f10a00c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10a015a8e0 0x7f10a00ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00caaa0 con 0x7f10a015a8e0 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f10a015d4f0 con 0x7f10a00c94f0 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f10a5400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f10a015d790 con 0x7f10a00ce750 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f1097e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10a015a8e0 0x7f10a00ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f1097e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10a015a8e0 0x7f10a00ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49450/0 (socket says 172.21.15.16:49450) 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f1097e00640 1 -- 172.21.15.16:0/3612754461 learned_addr learned my addr 172.21.15.16:0/3612754461 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f109f200640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.589+0000 7f109e800640 1 --2- 172.21.15.16:0/3612754461 >> v2:172.21.15.186:3300/0 conn(0x7f10a00c94f0 0x7f10a00c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 -- 172.21.15.16:0/3612754461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 msgr2=0x7f10a00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00c34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 -- 172.21.15.16:0/3612754461 >> v2:172.21.15.186:3300/0 conn(0x7f10a00c94f0 msgr2=0x7f10a00c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 --2- 172.21.15.16:0/3612754461 >> v2:172.21.15.186:3300/0 conn(0x7f10a00c94f0 0x7f10a00c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 -- 172.21.15.16:0/3612754461 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a015da70 con 0x7f10a015a8e0 2024-04-25T11:05:28.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f1097e00640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a00ce210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10a0071100 tx=0x7f108801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3637f7d24fff1543 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f109de00640 1 -- 172.21.15.16:0/3612754461 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880b4070 con 0x7f10a015a8e0 2024-04-25T11:05:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f109de00640 1 -- 172.21.15.16:0/3612754461 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10880a7ba0 con 0x7f10a015a8e0 2024-04-25T11:05:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.593+0000 7f109de00640 1 -- 172.21.15.16:0/3612754461 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880af440 con 0x7f10a015a8e0 2024-04-25T11:05:28.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- 172.21.15.16:0/3612754461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 msgr2=0x7f10a00ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a00ce210 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10a0071100 tx=0x7f108801ed10 comp rx=0 tx=0).stop 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- 172.21.15.16:0/3612754461 shutdown_connections 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 --2- 172.21.15.16:0/3612754461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a00ce210 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 --2- 172.21.15.16:0/3612754461 >> v2:172.21.15.186:3300/0 conn(0x7f10a00c94f0 0x7f10a00c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- 172.21.15.16:0/3612754461 >> 172.21.15.16:0/3612754461 conn(0x7f10a0072080 msgr2=0x7f10a0072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- 172.21.15.16:0/3612754461 shutdown_connections 2024-04-25T11:05:28.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- 172.21.15.16:0/3612754461 wait complete. 2024-04-25T11:05:28.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 Processor -- start 2024-04-25T11:05:28.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.597+0000 7f10a5400640 1 -- start start 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10a00c94f0 0x7f10a00cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f10a00cb6a0 con 0x7f10a015a8e0 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f10a00cb520 con 0x7f10a00c94f0 2024-04-25T11:05:28.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f10a00cb820 con 0x7f10a00ce750 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f109f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f109f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49454/0 (socket says 172.21.15.16:49454) 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f109f200640 1 -- 172.21.15.16:0/533934524 learned_addr learned my addr 172.21.15.16:0/533934524 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f109e800640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10a00c94f0 0x7f10a00cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 -- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10a00c94f0 msgr2=0x7f10a00cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10a00c94f0 0x7f10a00cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 -- 172.21.15.16:0/533934524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 msgr2=0x7f10a01faba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 -- 172.21.15.16:0/533934524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01526a0 con 0x7f10a00ce750 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f109f200640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:28.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1097e00640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00cc390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1088006fd0 tx=0x7f108801bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880b4040 con 0x7f10a00ce750 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10880be070 con 0x7f10a00ce750 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a00cc8d0 con 0x7f10a00ce750 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10880afda0 con 0x7f10a00ce750 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a0155340 con 0x7f10a00ce750 2024-04-25T11:05:28.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.601+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a01fba50 con 0x7f10a00ce750 2024-04-25T11:05:28.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.605+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f10880c3460 con 0x7f10a00ce750 2024-04-25T11:05:28.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.605+0000 7f1096a00640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 0x7f1078071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.605+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f108812cdd0 con 0x7f10a00ce750 2024-04-25T11:05:28.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.605+0000 7f109e800640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 0x7f1078071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.605+0000 7f109e800640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 0x7f1078071ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1090009ac0 tx=0x7f10900091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.617+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1088018900 con 0x7f10a00ce750 2024-04-25T11:05:28.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.781+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f10a006f110 con 0x7f10a00ce750 2024-04-25T11:05:28.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.781+0000 7f1096a00640 1 -- 172.21.15.16:0/533934524 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f10880f9220 con 0x7f10a00ce750 2024-04-25T11:05:28.785 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 msgr2=0x7f1078071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 0x7f1078071ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1090009ac0 tx=0x7f10900091c0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 msgr2=0x7f10a00cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00cc390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1088006fd0 tx=0x7f108801bab0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 shutdown_connections 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f107806f5a0 0x7f1078071ab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10a015a8e0 0x7f10a01faba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f10a00ce750 0x7f10a00cc390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 --2- 172.21.15.16:0/533934524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f10a00c94f0 0x7f10a00cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 >> 172.21.15.16:0/533934524 conn(0x7f10a0072080 msgr2=0x7f10a015c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 shutdown_connections 2024-04-25T11:05:28.788 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.785+0000 7f10a5400640 1 -- 172.21.15.16:0/533934524 wait complete. 2024-04-25T11:05:28.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T11:05:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 Processor -- start 2024-04-25T11:05:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 -- start start 2024-04-25T11:05:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c0b9a90 con 0x7f4d9c162850 2024-04-25T11:05:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9c06d0c0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.962 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.957+0000 7f4da4600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9c0c9020 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49460/0 (socket says 172.21.15.16:49460) 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 -- 172.21.15.16:0/730496818 learned_addr learned my addr 172.21.15.16:0/730496818 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 -- 172.21.15.16:0/730496818 >> v1:172.21.15.186:6789/0 conn(0x7f4d9c0c5870 legacy=0x7f4d9c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 -- 172.21.15.16:0/730496818 >> v1:172.21.15.16:6789/0 conn(0x7f4d9c162850 legacy=0x7f4d9c164c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 -- 172.21.15.16:0/730496818 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c0c94b0 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4da1200640 1 --2- 172.21.15.16:0/730496818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0c91a0 tx=0x7f4d8801ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f4ee136ca21d92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4d9be00640 1 -- 172.21.15.16:0/730496818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880b5070 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4d9be00640 1 -- 172.21.15.16:0/730496818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d880a8b50 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.961+0000 7f4d9be00640 1 -- 172.21.15.16:0/730496818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d880b0440 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- 172.21.15.16:0/730496818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5c80 msgr2=0x7f4d9c15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 --2- 172.21.15.16:0/730496818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0c91a0 tx=0x7f4d8801ee50 comp rx=0 tx=0).stop 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- 172.21.15.16:0/730496818 shutdown_connections 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 --2- 172.21.15.16:0/730496818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5c80 0x7f4d9c15dbe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- 172.21.15.16:0/730496818 >> 172.21.15.16:0/730496818 conn(0x7f4d9c0ca620 msgr2=0x7f4d9c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- 172.21.15.16:0/730496818 shutdown_connections 2024-04-25T11:05:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- 172.21.15.16:0/730496818 wait complete. 2024-04-25T11:05:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 Processor -- start 2024-04-25T11:05:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.965+0000 7f4da4600640 1 -- start start 2024-04-25T11:05:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d9c0c5c80 0x7f4d9c1fb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 0x7f4d9c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c0c86f0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c06d640 con 0x7f4d9c162850 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c0c89d0 con 0x7f4d9c0c5c80 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49464/0 (socket says 172.21.15.16:49464) 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 -- 172.21.15.16:0/463165000 learned_addr learned my addr 172.21.15.16:0/463165000 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1200640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d9c0c5c80 0x7f4d9c1fb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da2600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 0x7f4d9c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 -- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d9c0c5c80 msgr2=0x7f4d9c1fb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d9c0c5c80 0x7f4d9c1fb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 -- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 msgr2=0x7f4d9c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 0x7f4d9c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 -- 172.21.15.16:0/463165000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c1fbac0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da2600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 0x7f4d9c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da1c00640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000c4f0 tx=0x7f4d9000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90016020 con 0x7f4d9c0c5870 2024-04-25T11:05:28.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d900052f0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c14a740 con 0x7f4d9c0c5870 2024-04-25T11:05:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90007260 con 0x7f4d9c0c5870 2024-04-25T11:05:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1fa4e0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.969+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c050750 con 0x7f4d9c0c5870 2024-04-25T11:05:28.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.973+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4d900074c0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.973+0000 7f4d99600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 0x7f4d78071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:28.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.973+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4d9008f0b0 con 0x7f4d9c0c5870 2024-04-25T11:05:28.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.973+0000 7f4da1200640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 0x7f4d78071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:28.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.973+0000 7f4da1200640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 0x7f4d78071ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b2000 tx=0x7f4d88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:28.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:28.977+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d90020020 con 0x7f4d9c0c5870 2024-04-25T11:05:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d9c06e1f0 con 0x7f4d9c0c5870 2024-04-25T11:05:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4d99600640 1 -- 172.21.15.16:0/463165000 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f4d9005bbe0 con 0x7f4d9c0c5870 2024-04-25T11:05:29.155 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 msgr2=0x7f4d78071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 0x7f4d78071ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4d880b2000 tx=0x7f4d88008040 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 msgr2=0x7f4d9c153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000c4f0 tx=0x7f4d9000c9b0 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 shutdown_connections 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f4d7806f5a0 0x7f4d78071ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d9c162850 0x7f4d9c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d9c0c5c80 0x7f4d9c1fb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 --2- 172.21.15.16:0/463165000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d9c0c5870 0x7f4d9c153b30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 >> 172.21.15.16:0/463165000 conn(0x7f4d9c0ca620 msgr2=0x7f4d9c14d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 shutdown_connections 2024-04-25T11:05:29.158 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:29.153+0000 7f4da4600640 1 -- 172.21.15.16:0/463165000 wait complete. 2024-04-25T11:05:29.178 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T11:05:29.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:05:29.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T11:05:29.845 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:05:29.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:05:29.845 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T11:05:29.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:05:29.861 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2024-04-25T11:05:29.959 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T11:05:29.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:05:29.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T11:05:29.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T11:05:29.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2024-04-25T11:05:30.165 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T11:05:30.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T11:05:30.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:05:30.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.325+0000 7f4818400640 1 Processor -- start 2024-04-25T11:05:30.329 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.325+0000 7f4818400640 1 -- start start 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4818400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4810157580 0x7f481015d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4818400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f481015dca0 0x7f4810167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4818400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48100cb9b0 con 0x7f481006e430 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4818400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f481006dce0 con 0x7f4810157580 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4818400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4810157990 con 0x7f481015dca0 2024-04-25T11:05:30.331 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4810157580 0x7f481015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815a00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f481006e430 0x7f48100cbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35790/0 (socket says 172.21.15.16:35790) 2024-04-25T11:05:30.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815a00640 1 -- 172.21.15.16:0/1851746858 learned_addr learned my addr 172.21.15.16:0/1851746858 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:30.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4816400640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f481015dca0 0x7f4810167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815000640 1 -- 172.21.15.16:0/1851746858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f481015dca0 msgr2=0x7f4810167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:30.332 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815000640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f481015dca0 0x7f4810167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815000640 1 -- 172.21.15.16:0/1851746858 >> v1:172.21.15.16:6789/0 conn(0x7f481006e430 legacy=0x7f48100cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.333 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.329+0000 7f4815000640 1 -- 172.21.15.16:0/1851746858 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48100c8e30 con 0x7f4810157580 2024-04-25T11:05:30.334 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4815000640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4810157580 0x7f481015d760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009900 tx=0x7f47fc01ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e0ad005979969c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:30.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f480fe00640 1 -- 172.21.15.16:0/1851746858 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0b5070 con 0x7f4810157580 2024-04-25T11:05:30.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f480fe00640 1 -- 172.21.15.16:0/1851746858 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47fc0a8a90 con 0x7f4810157580 2024-04-25T11:05:30.335 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f480fe00640 1 -- 172.21.15.16:0/1851746858 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0b0440 con 0x7f4810157580 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- 172.21.15.16:0/1851746858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4810157580 msgr2=0x7f481015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4810157580 0x7f481015d760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009900 tx=0x7f47fc01ed90 comp rx=0 tx=0).stop 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- 172.21.15.16:0/1851746858 shutdown_connections 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f481015dca0 0x7f4810167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 --2- 172.21.15.16:0/1851746858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4810157580 0x7f481015d760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- 172.21.15.16:0/1851746858 >> 172.21.15.16:0/1851746858 conn(0x7f4810073150 msgr2=0x7f4810073640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- 172.21.15.16:0/1851746858 shutdown_connections 2024-04-25T11:05:30.336 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- 172.21.15.16:0/1851746858 wait complete. 2024-04-25T11:05:30.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 Processor -- start 2024-04-25T11:05:30.338 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.333+0000 7f4818400640 1 -- start start 2024-04-25T11:05:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f481006e430 0x7f4810150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 0x7f4810159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.341 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f48100c96d0 con 0x7f481015dca0 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f48100c93f0 con 0x7f481006e430 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f481015e0b0 con 0x7f4810157580 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49496/0 (socket says 172.21.15.16:49496) 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 -- 172.21.15.16:0/1994262007 learned_addr learned my addr 172.21.15.16:0/1994262007 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4815a00640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f481006e430 0x7f4810150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4815000640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 0x7f4810159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 -- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 msgr2=0x7f4810159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 0x7f4810159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 -- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f481006e430 msgr2=0x7f4810150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f481006e430 0x7f4810150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 -- 172.21.15.16:0/1994262007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4810151920 con 0x7f481015dca0 2024-04-25T11:05:30.342 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4815000640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 0x7f4810159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4816400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f480800ede0 tx=0x7f480800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808018020 con 0x7f481015dca0 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4808014480 con 0x7f481015dca0 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808014870 con 0x7f481015dca0 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4810159d90 con 0x7f481015dca0 2024-04-25T11:05:30.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4810157ce0 con 0x7f481015dca0 2024-04-25T11:05:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.337+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4810050750 con 0x7f481015dca0 2024-04-25T11:05:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.341+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f480801b020 con 0x7f481015dca0 2024-04-25T11:05:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.341+0000 7f480d600640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 0x7f47ec071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.344 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.341+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4808090730 con 0x7f481015dca0 2024-04-25T11:05:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.341+0000 7f4815a00640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 0x7f47ec071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.341+0000 7f4815a00640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 0x7f47ec071ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4804001050 tx=0x7f4804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:30.348 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.345+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4808022030 con 0x7f481015dca0 2024-04-25T11:05:30.515 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.513+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48100701c0 con 0x7f47ec06f5a0 2024-04-25T11:05:30.622 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.617+0000 7f480d600640 1 -- 172.21.15.16:0/1994262007 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336376 (secure 0 0 0) 0x7f48100701c0 con 0x7f47ec06f5a0 2024-04-25T11:05:30.628 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:30.631 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:05:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 msgr2=0x7f47ec071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 0x7f47ec071ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4804001050 tx=0x7f4804009040 comp rx=0 tx=0).stop 2024-04-25T11:05:30.634 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 msgr2=0x7f48100ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.635 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f480800ede0 tx=0x7f480800c490 comp rx=0 tx=0).stop 2024-04-25T11:05:30.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 shutdown_connections 2024-04-25T11:05:30.638 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f47ec06f5a0 0x7f47ec071ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f481015dca0 0x7f48100ce4e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4810157580 0x7f4810159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 --2- 172.21.15.16:0/1994262007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f481006e430 0x7f4810150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 >> 172.21.15.16:0/1994262007 conn(0x7f4810073150 msgr2=0x7f48101528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 shutdown_connections 2024-04-25T11:05:30.639 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.633+0000 7f4818400640 1 -- 172.21.15.16:0/1994262007 wait complete. 2024-04-25T11:05:30.670 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":824,"stamp":"2024-04-25T11:05:30.355126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292132854,"num_objects":453,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":7927,"num_read_kb":1313316,"num_write":298873,"num_write_kb":5285850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476550,"ondisk_log_size":476550,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5765044,"kb_used_data":307692,"kb_used_omap":12,"kb_used_meta":5457267,"kb_avail":749209676,"statfs":{"total":773094113280,"available":767190708224,"internally_reserved":0,"allocated":315076608,"data_stored":590831368,"data_compressed":60630618,"data_compressed_allocated":89006080,"data_compressed_original":366338048,"omap_allocated":12751,"internal_metadata":5588241969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,3,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-194504316,"num_objects":-1545,"num_object_clones":0,"num_object_copies":-5210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1545,"num_whiteouts":0,"num_read":25,"num_read_kb":3165,"num_write":2992,"num_write_kb":35827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004634"},"pg_stats":[{"pgid":"2.1f","version":"28'1879","reported_seq":1918,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:01:56.663229+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T11:01:56.663229+0000","last_peered":"2024-04-25T11:01:56.663229+0000","last_clean":"2024-04-25T11:01:56.663229+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:01:56.663229+0000","last_undegraded":"2024-04-25T11:01:56.663229+0000","last_fullsized":"2024-04-25T11:01:56.663229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1893,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1893","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857863+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T11:05:29.857863+0000","last_peered":"2024-04-25T11:05:29.857863+0000","last_clean":"2024-04-25T11:05:29.857863+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:29.857863+0000","last_undegraded":"2024-04-25T11:05:29.857863+0000","last_fullsized":"2024-04-25T11:05:29.857863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6388","reported_seq":6461,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.602400+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T11:05:29.602400+0000","last_peered":"2024-04-25T11:05:29.602400+0000","last_clean":"2024-04-25T11:05:29.602400+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:29.602400+0000","last_undegraded":"2024-04-25T11:05:29.602400+0000","last_fullsized":"2024-04-25T11:05:29.602400+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23133,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4423,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4891","reported_seq":4931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.612083+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T11:05:27.612083+0000","last_peered":"2024-04-25T11:05:27.612083+0000","last_clean":"2024-04-25T11:05:27.612083+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:27.612083+0000","last_undegraded":"2024-04-25T11:05:27.612083+0000","last_fullsized":"2024-04-25T11:05:27.612083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1892","reported_seq":1929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.554231+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T11:05:24.554231+0000","last_peered":"2024-04-25T11:05:24.554231+0000","last_clean":"2024-04-25T11:05:24.554231+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:24.554231+0000","last_undegraded":"2024-04-25T11:05:24.554231+0000","last_fullsized":"2024-04-25T11:05:24.554231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6747","reported_seq":6875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.976907+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T11:05:24.976907+0000","last_peered":"2024-04-25T11:05:24.976907+0000","last_clean":"2024-04-25T11:05:24.976907+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:24.976907+0000","last_undegraded":"2024-04-25T11:05:24.976907+0000","last_fullsized":"2024-04-25T11:05:24.976907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6747,"log_dups_size":0,"ondisk_log_size":6747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640448,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4751,"num_write_kb":130705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7161","reported_seq":7198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:12.813758+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T11:05:12.813758+0000","last_peered":"2024-04-25T11:05:12.813758+0000","last_clean":"2024-04-25T11:05:12.813758+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:12.813758+0000","last_undegraded":"2024-04-25T11:05:12.813758+0000","last_fullsized":"2024-04-25T11:05:12.813758+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7162,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1932","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635183+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T11:05:24.635183+0000","last_peered":"2024-04-25T11:05:24.635183+0000","last_clean":"2024-04-25T11:05:24.635183+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:24.635183+0000","last_undegraded":"2024-04-25T11:05:24.635183+0000","last_fullsized":"2024-04-25T11:05:24.635183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6457","reported_seq":6673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.734570+0000","last_change":"2024-04-25T10:39:39.057558+0000","last_active":"2024-04-25T11:05:24.734570+0000","last_peered":"2024-04-25T11:05:24.734570+0000","last_clean":"2024-04-25T11:05:24.734570+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:24.734570+0000","last_undegraded":"2024-04-25T11:05:24.734570+0000","last_fullsized":"2024-04-25T11:05:24.734570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6457,"log_dups_size":0,"ondisk_log_size":6457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4420,"num_write_kb":116213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3801","reported_seq":3838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.537738+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T11:05:08.537738+0000","last_peered":"2024-04-25T11:05:08.537738+0000","last_clean":"2024-04-25T11:05:08.537738+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:08.537738+0000","last_undegraded":"2024-04-25T11:05:08.537738+0000","last_fullsized":"2024-04-25T11:05:08.537738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3804,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1878","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.030107+0000","last_change":"2024-04-25T10:39:38.922901+0000","last_active":"2024-04-25T11:05:24.030107+0000","last_peered":"2024-04-25T11:05:24.030107+0000","last_clean":"2024-04-25T11:05:24.030107+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:24.030107+0000","last_undegraded":"2024-04-25T11:05:24.030107+0000","last_fullsized":"2024-04-25T11:05:24.030107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6614","reported_seq":6735,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.655131+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T11:05:24.655131+0000","last_peered":"2024-04-25T11:05:24.655131+0000","last_clean":"2024-04-25T11:05:24.655131+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:24.655131+0000","last_undegraded":"2024-04-25T11:05:24.655131+0000","last_fullsized":"2024-04-25T11:05:24.655131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6614,"log_dups_size":0,"ondisk_log_size":6614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":937291,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4650,"num_write_kb":122056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1909","reported_seq":1946,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.856637+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T11:05:24.856637+0000","last_peered":"2024-04-25T11:05:24.856637+0000","last_clean":"2024-04-25T11:05:24.856637+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:24.856637+0000","last_undegraded":"2024-04-25T11:05:24.856637+0000","last_fullsized":"2024-04-25T11:05:24.856637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5501","reported_seq":5539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:45.406535+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T11:03:45.406535+0000","last_peered":"2024-04-25T11:03:45.406535+0000","last_clean":"2024-04-25T11:03:45.406535+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:03:45.406535+0000","last_undegraded":"2024-04-25T11:03:45.406535+0000","last_fullsized":"2024-04-25T11:03:45.406535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5501,"log_dups_size":0,"ondisk_log_size":5501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5518,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6767","reported_seq":6845,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.942115+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T11:05:24.942115+0000","last_peered":"2024-04-25T11:05:24.942115+0000","last_clean":"2024-04-25T11:05:24.942115+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:24.942115+0000","last_undegraded":"2024-04-25T11:05:24.942115+0000","last_fullsized":"2024-04-25T11:05:24.942115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6767,"log_dups_size":0,"ondisk_log_size":6767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83190,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4710,"num_write_kb":126882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1919","reported_seq":1955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857498+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T11:05:29.857498+0000","last_peered":"2024-04-25T11:05:29.857498+0000","last_clean":"2024-04-25T11:05:29.857498+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:29.857498+0000","last_undegraded":"2024-04-25T11:05:29.857498+0000","last_fullsized":"2024-04-25T11:05:29.857498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4960","reported_seq":5000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:13.419386+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T11:04:13.419386+0000","last_peered":"2024-04-25T11:04:13.419386+0000","last_clean":"2024-04-25T11:04:13.419386+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:04:13.419386+0000","last_undegraded":"2024-04-25T11:04:13.419386+0000","last_fullsized":"2024-04-25T11:04:13.419386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4959,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7052","reported_seq":7152,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914288+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T11:05:24.914288+0000","last_peered":"2024-04-25T11:05:24.914288+0000","last_clean":"2024-04-25T11:05:24.914288+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:24.914288+0000","last_undegraded":"2024-04-25T11:05:24.914288+0000","last_fullsized":"2024-04-25T11:05:24.914288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5087,"num_write_kb":139955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1950","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.851278+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T11:05:29.851278+0000","last_peered":"2024-04-25T11:05:29.851278+0000","last_clean":"2024-04-25T11:05:29.851278+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:29.851278+0000","last_undegraded":"2024-04-25T11:05:29.851278+0000","last_fullsized":"2024-04-25T11:05:29.851278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1950,"log_dups_size":0,"ondisk_log_size":1950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2275","reported_seq":2315,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:54.070815+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T11:03:54.070815+0000","last_peered":"2024-04-25T11:03:54.070815+0000","last_clean":"2024-04-25T11:03:54.070815+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:03:54.070815+0000","last_undegraded":"2024-04-25T11:03:54.070815+0000","last_fullsized":"2024-04-25T11:03:54.070815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2275,"log_dups_size":0,"ondisk_log_size":2275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2283,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6667","reported_seq":6810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.721941+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T11:05:24.721941+0000","last_peered":"2024-04-25T11:05:24.721941+0000","last_clean":"2024-04-25T11:05:24.721941+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:24.721941+0000","last_undegraded":"2024-04-25T11:05:24.721941+0000","last_fullsized":"2024-04-25T11:05:24.721941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6667,"log_dups_size":0,"ondisk_log_size":6667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4759,"num_write_kb":122782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1930","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.439676+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T11:05:24.439676+0000","last_peered":"2024-04-25T11:05:24.439676+0000","last_clean":"2024-04-25T11:05:24.439676+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:24.439676+0000","last_undegraded":"2024-04-25T11:05:24.439676+0000","last_fullsized":"2024-04-25T11:05:24.439676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1616","reported_seq":1655,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:54.280349+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T11:04:54.280349+0000","last_peered":"2024-04-25T11:04:54.280349+0000","last_clean":"2024-04-25T11:04:54.280349+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:04:54.280349+0000","last_undegraded":"2024-04-25T11:04:54.280349+0000","last_fullsized":"2024-04-25T11:04:54.280349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1627,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7407","reported_seq":7508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.824089+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T11:05:24.824089+0000","last_peered":"2024-04-25T11:05:24.824089+0000","last_clean":"2024-04-25T11:05:24.824089+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:24.824089+0000","last_undegraded":"2024-04-25T11:05:24.824089+0000","last_fullsized":"2024-04-25T11:05:24.824089+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5357,"num_write_kb":119171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.698283+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T11:05:24.698283+0000","last_peered":"2024-04-25T11:05:24.698283+0000","last_clean":"2024-04-25T11:05:24.698283+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:24.698283+0000","last_undegraded":"2024-04-25T11:05:24.698283+0000","last_fullsized":"2024-04-25T11:05:24.698283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2472","reported_seq":2511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.217363+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T11:04:08.217363+0000","last_peered":"2024-04-25T11:04:08.217363+0000","last_clean":"2024-04-25T11:04:08.217363+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:04:08.217363+0000","last_undegraded":"2024-04-25T11:04:08.217363+0000","last_fullsized":"2024-04-25T11:04:08.217363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2472,"log_dups_size":0,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2498,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6585","reported_seq":6690,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.773668+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T11:05:24.773668+0000","last_peered":"2024-04-25T11:05:24.773668+0000","last_clean":"2024-04-25T11:05:24.773668+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:24.773668+0000","last_undegraded":"2024-04-25T11:05:24.773668+0000","last_fullsized":"2024-04-25T11:05:24.773668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4614,"num_write_kb":126370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1849","reported_seq":1886,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.868941+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T11:05:29.868941+0000","last_peered":"2024-04-25T11:05:29.868941+0000","last_clean":"2024-04-25T11:05:29.868941+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:29.868941+0000","last_undegraded":"2024-04-25T11:05:29.868941+0000","last_fullsized":"2024-04-25T11:05:29.868941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4061","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.208428+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T11:05:27.208428+0000","last_peered":"2024-04-25T11:05:27.208428+0000","last_clean":"2024-04-25T11:05:27.208428+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:27.208428+0000","last_undegraded":"2024-04-25T11:05:27.208428+0000","last_fullsized":"2024-04-25T11:05:27.208428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4061,"log_dups_size":0,"ondisk_log_size":4061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525529,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":556,"num_write":6791,"num_write_kb":36780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6491","reported_seq":6700,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617295+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T11:05:29.617295+0000","last_peered":"2024-04-25T11:05:29.617295+0000","last_clean":"2024-04-25T11:05:29.617295+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:29.617295+0000","last_undegraded":"2024-04-25T11:05:29.617295+0000","last_fullsized":"2024-04-25T11:05:29.617295+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6291,"log_dups_size":0,"ondisk_log_size":6291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751125,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4480,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1912","reported_seq":1950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.004886+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T11:05:24.004886+0000","last_peered":"2024-04-25T11:05:24.004886+0000","last_clean":"2024-04-25T11:05:24.004886+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:24.004886+0000","last_undegraded":"2024-04-25T11:05:24.004886+0000","last_fullsized":"2024-04-25T11:05:24.004886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4555","reported_seq":4594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.162006+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T11:04:08.162006+0000","last_peered":"2024-04-25T11:04:08.162006+0000","last_clean":"2024-04-25T11:04:08.162006+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:04:08.162006+0000","last_undegraded":"2024-04-25T11:04:08.162006+0000","last_fullsized":"2024-04-25T11:04:08.162006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4555,"log_dups_size":0,"ondisk_log_size":4555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4566,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7267","reported_seq":7517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.955878+0000","last_change":"2024-04-25T10:39:39.090203+0000","last_active":"2024-04-25T11:05:24.955878+0000","last_peered":"2024-04-25T11:05:24.955878+0000","last_clean":"2024-04-25T11:05:24.955878+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:24.955878+0000","last_undegraded":"2024-04-25T11:05:24.955878+0000","last_fullsized":"2024-04-25T11:05:24.955878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7267,"log_dups_size":0,"ondisk_log_size":7267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3488000,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5258,"num_write_kb":158271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1885","reported_seq":1923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.783599+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T11:05:24.783599+0000","last_peered":"2024-04-25T11:05:24.783599+0000","last_clean":"2024-04-25T11:05:24.783599+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:24.783599+0000","last_undegraded":"2024-04-25T11:05:24.783599+0000","last_fullsized":"2024-04-25T11:05:24.783599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4320","reported_seq":4360,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:03.302219+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T11:05:03.302219+0000","last_peered":"2024-04-25T11:05:03.302219+0000","last_clean":"2024-04-25T11:05:03.302219+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:03.302219+0000","last_undegraded":"2024-04-25T11:05:03.302219+0000","last_fullsized":"2024-04-25T11:05:03.302219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4326,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7443","reported_seq":7736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.621494+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T11:05:24.621494+0000","last_peered":"2024-04-25T11:05:24.621494+0000","last_clean":"2024-04-25T11:05:24.621494+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:24.621494+0000","last_undegraded":"2024-04-25T11:05:24.621494+0000","last_fullsized":"2024-04-25T11:05:24.621494+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7343,"log_dups_size":0,"ondisk_log_size":7343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4627106,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5425,"num_write_kb":156322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1901","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.961767+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T11:05:24.961767+0000","last_peered":"2024-04-25T11:05:24.961767+0000","last_clean":"2024-04-25T11:05:24.961767+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:24.961767+0000","last_undegraded":"2024-04-25T11:05:24.961767+0000","last_fullsized":"2024-04-25T11:05:24.961767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5566","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:07.927173+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T11:03:07.927173+0000","last_peered":"2024-04-25T11:03:07.927173+0000","last_clean":"2024-04-25T11:03:07.927173+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:03:07.927173+0000","last_undegraded":"2024-04-25T11:03:07.927173+0000","last_fullsized":"2024-04-25T11:03:07.927173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5566,"log_dups_size":0,"ondisk_log_size":5566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5571,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6953","reported_seq":7026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.838139+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T11:05:24.838139+0000","last_peered":"2024-04-25T11:05:24.838139+0000","last_clean":"2024-04-25T11:05:24.838139+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:24.838139+0000","last_undegraded":"2024-04-25T11:05:24.838139+0000","last_fullsized":"2024-04-25T11:05:24.838139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6953,"log_dups_size":0,"ondisk_log_size":6953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785024,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4969,"num_write_kb":146106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1903","reported_seq":1942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.409006+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T11:05:24.409006+0000","last_peered":"2024-04-25T11:05:24.409006+0000","last_clean":"2024-04-25T11:05:24.409006+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:24.409006+0000","last_undegraded":"2024-04-25T11:05:24.409006+0000","last_fullsized":"2024-04-25T11:05:24.409006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6022","reported_seq":7458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:10.103236+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T11:04:10.103236+0000","last_peered":"2024-04-25T11:04:10.103236+0000","last_clean":"2024-04-25T11:04:10.103236+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:04:10.103236+0000","last_undegraded":"2024-04-25T11:04:10.103236+0000","last_fullsized":"2024-04-25T11:04:10.103236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6022,"log_dups_size":0,"ondisk_log_size":6022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6036,"num_write_kb":43945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6540","reported_seq":7081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.886058+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T11:05:24.886058+0000","last_peered":"2024-04-25T11:05:24.886058+0000","last_clean":"2024-04-25T11:05:24.886058+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:24.886058+0000","last_undegraded":"2024-04-25T11:05:24.886058+0000","last_fullsized":"2024-04-25T11:05:24.886058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6540,"log_dups_size":0,"ondisk_log_size":6540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347382,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4571,"num_write_kb":125130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.676299+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T11:05:24.676299+0000","last_peered":"2024-04-25T11:05:24.676299+0000","last_clean":"2024-04-25T11:05:24.676299+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:24.676299+0000","last_undegraded":"2024-04-25T11:05:24.676299+0000","last_fullsized":"2024-04-25T11:05:24.676299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5526","reported_seq":5566,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:04.930461+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T11:05:04.930461+0000","last_peered":"2024-04-25T11:05:04.930461+0000","last_clean":"2024-04-25T11:05:04.930461+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:04.930461+0000","last_undegraded":"2024-04-25T11:05:04.930461+0000","last_fullsized":"2024-04-25T11:05:04.930461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5526,"log_dups_size":0,"ondisk_log_size":5526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5535,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6619","reported_seq":6739,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914010+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T11:05:24.914010+0000","last_peered":"2024-04-25T11:05:24.914010+0000","last_clean":"2024-04-25T11:05:24.914010+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:24.914010+0000","last_undegraded":"2024-04-25T11:05:24.914010+0000","last_fullsized":"2024-04-25T11:05:24.914010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6619,"log_dups_size":0,"ondisk_log_size":6619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1997569,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4568,"num_write_kb":119677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1940","reported_seq":1977,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.863204+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T11:05:29.863204+0000","last_peered":"2024-04-25T11:05:29.863204+0000","last_clean":"2024-04-25T11:05:29.863204+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:29.863204+0000","last_undegraded":"2024-04-25T11:05:29.863204+0000","last_fullsized":"2024-04-25T11:05:29.863204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3766","reported_seq":3806,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:01.058872+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T11:04:01.058872+0000","last_peered":"2024-04-25T11:04:01.058872+0000","last_clean":"2024-04-25T11:04:01.058872+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:04:01.058872+0000","last_undegraded":"2024-04-25T11:04:01.058872+0000","last_fullsized":"2024-04-25T11:04:01.058872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3779,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:55.392906+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T11:02:55.392906+0000","last_peered":"2024-04-25T11:02:55.392906+0000","last_clean":"2024-04-25T11:02:55.392906+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:02:55.392906+0000","last_undegraded":"2024-04-25T11:02:55.392906+0000","last_fullsized":"2024-04-25T11:02:55.392906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6731","reported_seq":6866,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.935024+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T11:05:24.935024+0000","last_peered":"2024-04-25T11:05:24.935024+0000","last_clean":"2024-04-25T11:05:24.935024+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:24.935024+0000","last_undegraded":"2024-04-25T11:05:24.935024+0000","last_fullsized":"2024-04-25T11:05:24.935024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6731,"log_dups_size":0,"ondisk_log_size":6731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947904,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4783,"num_write_kb":129912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1903","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.784084+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T11:05:24.784084+0000","last_peered":"2024-04-25T11:05:24.784084+0000","last_clean":"2024-04-25T11:05:24.784084+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:24.784084+0000","last_undegraded":"2024-04-25T11:05:24.784084+0000","last_fullsized":"2024-04-25T11:05:24.784084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4301","reported_seq":4340,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:17.258158+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T11:04:17.258158+0000","last_peered":"2024-04-25T11:04:17.258158+0000","last_clean":"2024-04-25T11:04:17.258158+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:04:17.258158+0000","last_undegraded":"2024-04-25T11:04:17.258158+0000","last_fullsized":"2024-04-25T11:04:17.258158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4301,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6640","reported_seq":6864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.863696+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T11:05:24.863696+0000","last_peered":"2024-04-25T11:05:24.863696+0000","last_clean":"2024-04-25T11:05:24.863696+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:24.863696+0000","last_undegraded":"2024-04-25T11:05:24.863696+0000","last_fullsized":"2024-04-25T11:05:24.863696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6640,"log_dups_size":0,"ondisk_log_size":6640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2199360,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4599,"num_write_kb":120343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1891","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.901993+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T11:05:24.901993+0000","last_peered":"2024-04-25T11:05:24.901993+0000","last_clean":"2024-04-25T11:05:24.901993+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:24.901993+0000","last_undegraded":"2024-04-25T11:05:24.901993+0000","last_fullsized":"2024-04-25T11:05:24.901993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5439","reported_seq":5478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:22.004363+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T11:03:22.004363+0000","last_peered":"2024-04-25T11:03:22.004363+0000","last_clean":"2024-04-25T11:03:22.004363+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:03:22.004363+0000","last_undegraded":"2024-04-25T11:03:22.004363+0000","last_fullsized":"2024-04-25T11:03:22.004363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5439,"log_dups_size":0,"ondisk_log_size":5439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5440,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6660","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.845436+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T11:05:24.845436+0000","last_peered":"2024-04-25T11:05:24.845436+0000","last_clean":"2024-04-25T11:05:24.845436+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:24.845436+0000","last_undegraded":"2024-04-25T11:05:24.845436+0000","last_fullsized":"2024-04-25T11:05:24.845436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6660,"log_dups_size":0,"ondisk_log_size":6660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704832,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4609,"num_write_kb":135068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1826","reported_seq":1847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.700110+0000","last_change":"2024-04-25T10:39:38.923770+0000","last_active":"2024-04-25T11:05:24.700110+0000","last_peered":"2024-04-25T11:05:24.700110+0000","last_clean":"2024-04-25T11:05:24.700110+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:24.700110+0000","last_undegraded":"2024-04-25T11:05:24.700110+0000","last_fullsized":"2024-04-25T11:05:24.700110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:27.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4831","reported_seq":4870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:21.224189+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T11:05:21.224189+0000","last_peered":"2024-04-25T11:05:21.224189+0000","last_clean":"2024-04-25T11:05:21.224189+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:21.224189+0000","last_undegraded":"2024-04-25T11:05:21.224189+0000","last_fullsized":"2024-04-25T11:05:21.224189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4831,"log_dups_size":0,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4836,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7074","reported_seq":7141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.997288+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T11:05:24.997288+0000","last_peered":"2024-04-25T11:05:24.997288+0000","last_clean":"2024-04-25T11:05:24.997288+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:24.997288+0000","last_undegraded":"2024-04-25T11:05:24.997288+0000","last_fullsized":"2024-04-25T11:05:24.997288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7074,"log_dups_size":0,"ondisk_log_size":7074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5043,"num_write_kb":119741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1915","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.501936+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T11:05:24.501936+0000","last_peered":"2024-04-25T11:05:24.501936+0000","last_clean":"2024-04-25T11:05:24.501936+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:24.501936+0000","last_undegraded":"2024-04-25T11:05:24.501936+0000","last_fullsized":"2024-04-25T11:05:24.501936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3721","reported_seq":3760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.536781+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T11:05:08.536781+0000","last_peered":"2024-04-25T11:05:08.536781+0000","last_clean":"2024-04-25T11:05:08.536781+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:08.536781+0000","last_undegraded":"2024-04-25T11:05:08.536781+0000","last_fullsized":"2024-04-25T11:05:08.536781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3721,"log_dups_size":0,"ondisk_log_size":3721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3718,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6586","reported_seq":6710,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.848846+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T11:05:24.848846+0000","last_peered":"2024-04-25T11:05:24.848846+0000","last_clean":"2024-04-25T11:05:24.848846+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:24.848846+0000","last_undegraded":"2024-04-25T11:05:24.848846+0000","last_fullsized":"2024-04-25T11:05:24.848846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6586,"log_dups_size":0,"ondisk_log_size":6586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153332,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4494,"num_write_kb":119096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1931","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.870826+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T11:05:24.870826+0000","last_peered":"2024-04-25T11:05:24.870826+0000","last_clean":"2024-04-25T11:05:24.870826+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:24.870826+0000","last_undegraded":"2024-04-25T11:05:24.870826+0000","last_fullsized":"2024-04-25T11:05:24.870826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2218","reported_seq":2257,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:41.881885+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T11:02:41.881885+0000","last_peered":"2024-04-25T11:02:41.881885+0000","last_clean":"2024-04-25T11:02:41.881885+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:02:41.881885+0000","last_undegraded":"2024-04-25T11:02:41.881885+0000","last_fullsized":"2024-04-25T11:02:41.881885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2233,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6549","reported_seq":6799,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.441422+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T11:05:24.441422+0000","last_peered":"2024-04-25T11:05:24.441422+0000","last_clean":"2024-04-25T11:05:24.441422+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:24.441422+0000","last_undegraded":"2024-04-25T11:05:24.441422+0000","last_fullsized":"2024-04-25T11:05:24.441422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778338,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4507,"num_write_kb":126341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1845","reported_seq":1881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.008456+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T11:05:25.008456+0000","last_peered":"2024-04-25T11:05:25.008456+0000","last_clean":"2024-04-25T11:05:25.008456+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:25.008456+0000","last_undegraded":"2024-04-25T11:05:25.008456+0000","last_fullsized":"2024-04-25T11:05:25.008456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1709","reported_seq":1747,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:37.187411+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T11:04:37.187411+0000","last_peered":"2024-04-25T11:04:37.187411+0000","last_clean":"2024-04-25T11:04:37.187411+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:04:37.187411+0000","last_undegraded":"2024-04-25T11:04:37.187411+0000","last_fullsized":"2024-04-25T11:04:37.187411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1713,"num_write_kb":21293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6811","reported_seq":6902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.475137+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T11:05:29.475137+0000","last_peered":"2024-04-25T11:05:29.475137+0000","last_clean":"2024-04-25T11:05:29.475137+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:29.475137+0000","last_undegraded":"2024-04-25T11:05:29.475137+0000","last_fullsized":"2024-04-25T11:05:29.475137+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2794578,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4806,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1895","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.229038+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T11:05:24.229038+0000","last_peered":"2024-04-25T11:05:24.229038+0000","last_clean":"2024-04-25T11:05:24.229038+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:24.229038+0000","last_undegraded":"2024-04-25T11:05:24.229038+0000","last_fullsized":"2024-04-25T11:05:24.229038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1895,"log_dups_size":0,"ondisk_log_size":1895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1354","reported_seq":1393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:42.358941+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T11:04:42.358941+0000","last_peered":"2024-04-25T11:04:42.358941+0000","last_clean":"2024-04-25T11:04:42.358941+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:04:42.358941+0000","last_undegraded":"2024-04-25T11:04:42.358941+0000","last_fullsized":"2024-04-25T11:04:42.358941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1360,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6430","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.528634+0000","last_change":"2024-04-25T10:39:39.093855+0000","last_active":"2024-04-25T11:05:29.528634+0000","last_peered":"2024-04-25T11:05:29.528634+0000","last_clean":"2024-04-25T11:05:29.528634+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:29.528634+0000","last_undegraded":"2024-04-25T11:05:29.528634+0000","last_fullsized":"2024-04-25T11:05:29.528634+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.407701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2247300,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4459,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1918","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.889620+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T11:05:24.889620+0000","last_peered":"2024-04-25T11:05:24.889620+0000","last_clean":"2024-04-25T11:05:24.889620+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:24.889620+0000","last_undegraded":"2024-04-25T11:05:24.889620+0000","last_fullsized":"2024-04-25T11:05:24.889620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1918,"log_dups_size":0,"ondisk_log_size":1918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3868","reported_seq":3906,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:23.139020+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T11:04:23.139020+0000","last_peered":"2024-04-25T11:04:23.139020+0000","last_clean":"2024-04-25T11:04:23.139020+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:04:23.139020+0000","last_undegraded":"2024-04-25T11:04:23.139020+0000","last_fullsized":"2024-04-25T11:04:23.139020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3868,"log_dups_size":0,"ondisk_log_size":3868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3879,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6414","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.694597+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T11:05:24.694597+0000","last_peered":"2024-04-25T11:05:24.694597+0000","last_clean":"2024-04-25T11:05:24.694597+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:24.694597+0000","last_undegraded":"2024-04-25T11:05:24.694597+0000","last_fullsized":"2024-04-25T11:05:24.694597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2392064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4464,"num_write_kb":118058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1845","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635070+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T11:05:24.635070+0000","last_peered":"2024-04-25T11:05:24.635070+0000","last_clean":"2024-04-25T11:05:24.635070+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:24.635070+0000","last_undegraded":"2024-04-25T11:05:24.635070+0000","last_fullsized":"2024-04-25T11:05:24.635070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7352","reported_seq":8015,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.342654+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T11:05:25.342654+0000","last_peered":"2024-04-25T11:05:25.342654+0000","last_clean":"2024-04-25T11:05:25.342654+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:25.342654+0000","last_undegraded":"2024-04-25T11:05:25.342654+0000","last_fullsized":"2024-04-25T11:05:25.342654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7352,"log_dups_size":0,"ondisk_log_size":7352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18861223,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7361,"num_write_kb":54825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6556","reported_seq":6620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.893573+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T11:05:24.893573+0000","last_peered":"2024-04-25T11:05:24.893573+0000","last_clean":"2024-04-25T11:05:24.893573+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:24.893573+0000","last_undegraded":"2024-04-25T11:05:24.893573+0000","last_fullsized":"2024-04-25T11:05:24.893573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6556,"log_dups_size":0,"ondisk_log_size":6556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457462,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4565,"num_write_kb":116078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.941108+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T11:05:24.941108+0000","last_peered":"2024-04-25T11:05:24.941108+0000","last_clean":"2024-04-25T11:05:24.941108+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:24.941108+0000","last_undegraded":"2024-04-25T11:05:24.941108+0000","last_fullsized":"2024-04-25T11:05:24.941108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5160","reported_seq":5198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.043331+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T11:05:23.043331+0000","last_peered":"2024-04-25T11:05:23.043331+0000","last_clean":"2024-04-25T11:05:23.043331+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:23.043331+0000","last_undegraded":"2024-04-25T11:05:23.043331+0000","last_fullsized":"2024-04-25T11:05:23.043331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5160,"log_dups_size":0,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5167,"num_write_kb":31677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6454","reported_seq":6511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.683667+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T11:05:24.683667+0000","last_peered":"2024-04-25T11:05:24.683667+0000","last_clean":"2024-04-25T11:05:24.683667+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:24.683667+0000","last_undegraded":"2024-04-25T11:05:24.683667+0000","last_fullsized":"2024-04-25T11:05:24.683667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152907,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4389,"num_write_kb":121841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1909","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.740602+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T11:05:24.740602+0000","last_peered":"2024-04-25T11:05:24.740602+0000","last_clean":"2024-04-25T11:05:24.740602+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:24.740602+0000","last_undegraded":"2024-04-25T11:05:24.740602+0000","last_fullsized":"2024-04-25T11:05:24.740602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5283","reported_seq":5321,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.192326+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T11:04:08.192326+0000","last_peered":"2024-04-25T11:04:08.192326+0000","last_clean":"2024-04-25T11:04:08.192326+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:04:08.192326+0000","last_undegraded":"2024-04-25T11:04:08.192326+0000","last_fullsized":"2024-04-25T11:04:08.192326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5288,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6496","reported_seq":6832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.606606+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T11:05:29.606606+0000","last_peered":"2024-04-25T11:05:29.606606+0000","last_clean":"2024-04-25T11:05:29.606606+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:29.606606+0000","last_undegraded":"2024-04-25T11:05:29.606606+0000","last_fullsized":"2024-04-25T11:05:29.606606+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6296,"log_dups_size":0,"ondisk_log_size":6296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406930,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4578,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1869","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.582270+0000","last_change":"2024-04-25T10:39:38.920344+0000","last_active":"2024-04-25T11:05:23.582270+0000","last_peered":"2024-04-25T11:05:23.582270+0000","last_clean":"2024-04-25T11:05:23.582270+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:23.582270+0000","last_undegraded":"2024-04-25T11:05:23.582270+0000","last_fullsized":"2024-04-25T11:05:23.582270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1869,"log_dups_size":0,"ondisk_log_size":1869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4609","reported_seq":5259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:00.879470+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T11:05:00.879470+0000","last_peered":"2024-04-25T11:05:00.879470+0000","last_clean":"2024-04-25T11:05:00.879470+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:00.879470+0000","last_undegraded":"2024-04-25T11:05:00.879470+0000","last_fullsized":"2024-04-25T11:05:00.879470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4607,"num_write_kb":39069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6794","reported_seq":7231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617793+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T11:05:29.617793+0000","last_peered":"2024-04-25T11:05:29.617793+0000","last_clean":"2024-04-25T11:05:29.617793+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:29.617793+0000","last_undegraded":"2024-04-25T11:05:29.617793+0000","last_fullsized":"2024-04-25T11:05:29.617793+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6293,"log_dups_size":0,"ondisk_log_size":6293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094726,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4765,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6711","reported_seq":6847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862188+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T11:05:24.862188+0000","last_peered":"2024-04-25T11:05:24.862188+0000","last_clean":"2024-04-25T11:05:24.862188+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:24.862188+0000","last_undegraded":"2024-04-25T11:05:24.862188+0000","last_fullsized":"2024-04-25T11:05:24.862188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6711,"log_dups_size":0,"ondisk_log_size":6711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581376,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4776,"num_write_kb":127958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1838","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.539513+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T11:05:24.539513+0000","last_peered":"2024-04-25T11:05:24.539513+0000","last_clean":"2024-04-25T11:05:24.539513+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:24.539513+0000","last_undegraded":"2024-04-25T11:05:24.539513+0000","last_fullsized":"2024-04-25T11:05:24.539513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7631","reported_seq":7669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:17.560722+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T11:05:17.560722+0000","last_peered":"2024-04-25T11:05:17.560722+0000","last_clean":"2024-04-25T11:05:17.560722+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:17.560722+0000","last_undegraded":"2024-04-25T11:05:17.560722+0000","last_fullsized":"2024-04-25T11:05:17.560722+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6425","reported_seq":6755,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.702013+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T11:05:24.702013+0000","last_peered":"2024-04-25T11:05:24.702013+0000","last_clean":"2024-04-25T11:05:24.702013+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:24.702013+0000","last_undegraded":"2024-04-25T11:05:24.702013+0000","last_fullsized":"2024-04-25T11:05:24.702013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6425,"log_dups_size":0,"ondisk_log_size":6425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4450,"num_write_kb":134560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1937","reported_seq":1972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.850546+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T11:05:29.850546+0000","last_peered":"2024-04-25T11:05:29.850546+0000","last_clean":"2024-04-25T11:05:29.850546+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:29.850546+0000","last_undegraded":"2024-04-25T11:05:29.850546+0000","last_fullsized":"2024-04-25T11:05:29.850546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3989","reported_seq":4026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:52.467207+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T11:03:52.467207+0000","last_peered":"2024-04-25T11:03:52.467207+0000","last_clean":"2024-04-25T11:03:52.467207+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:03:52.467207+0000","last_undegraded":"2024-04-25T11:03:52.467207+0000","last_fullsized":"2024-04-25T11:03:52.467207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7614","reported_seq":7651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:56.887780+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T11:04:56.887780+0000","last_peered":"2024-04-25T11:04:56.887780+0000","last_clean":"2024-04-25T11:04:56.887780+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:04:56.887780+0000","last_undegraded":"2024-04-25T11:04:56.887780+0000","last_fullsized":"2024-04-25T11:04:56.887780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7614,"log_dups_size":0,"ondisk_log_size":7614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7610,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1853","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.742622+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T11:05:23.742622+0000","last_peered":"2024-04-25T11:05:23.742622+0000","last_clean":"2024-04-25T11:05:23.742622+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:23.742622+0000","last_undegraded":"2024-04-25T11:05:23.742622+0000","last_fullsized":"2024-04-25T11:05:23.742622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6812","reported_seq":6896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.661366+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T11:05:24.661366+0000","last_peered":"2024-04-25T11:05:24.661366+0000","last_clean":"2024-04-25T11:05:24.661366+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:24.661366+0000","last_undegraded":"2024-04-25T11:05:24.661366+0000","last_fullsized":"2024-04-25T11:05:24.661366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6812,"log_dups_size":0,"ondisk_log_size":6812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700736,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4753,"num_write_kb":142652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5972","reported_seq":6009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.617686+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T11:05:27.617686+0000","last_peered":"2024-04-25T11:05:27.617686+0000","last_clean":"2024-04-25T11:05:27.617686+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:27.617686+0000","last_undegraded":"2024-04-25T11:05:27.617686+0000","last_fullsized":"2024-04-25T11:05:27.617686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1911","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.563146+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T11:05:24.563146+0000","last_peered":"2024-04-25T11:05:24.563146+0000","last_clean":"2024-04-25T11:05:24.563146+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:24.563146+0000","last_undegraded":"2024-04-25T11:05:24.563146+0000","last_fullsized":"2024-04-25T11:05:24.563146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7355","reported_seq":7908,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.565580+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T11:05:29.565580+0000","last_peered":"2024-04-25T11:05:29.565580+0000","last_clean":"2024-04-25T11:05:29.565580+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:29.565580+0000","last_undegraded":"2024-04-25T11:05:29.565580+0000","last_fullsized":"2024-04-25T11:05:29.565580+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6321,"log_dups_size":0,"ondisk_log_size":6321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964058,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5328,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1828","reported_seq":1865,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.654563+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T11:05:24.654563+0000","last_peered":"2024-04-25T11:05:24.654563+0000","last_clean":"2024-04-25T11:05:24.654563+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:24.654563+0000","last_undegraded":"2024-04-25T11:05:24.654563+0000","last_fullsized":"2024-04-25T11:05:24.654563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1931","reported_seq":1969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.766112+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T11:05:24.766112+0000","last_peered":"2024-04-25T11:05:24.766112+0000","last_clean":"2024-04-25T11:05:24.766112+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:24.766112+0000","last_undegraded":"2024-04-25T11:05:24.766112+0000","last_fullsized":"2024-04-25T11:05:24.766112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1840","reported_seq":1878,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.406515+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T11:05:24.406515+0000","last_peered":"2024-04-25T11:05:24.406515+0000","last_clean":"2024-04-25T11:05:24.406515+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:24.406515+0000","last_undegraded":"2024-04-25T11:05:24.406515+0000","last_fullsized":"2024-04-25T11:05:24.406515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1933","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810629+0000","last_change":"2024-04-25T10:39:38.921341+0000","last_active":"2024-04-25T11:05:24.810629+0000","last_peered":"2024-04-25T11:05:24.810629+0000","last_clean":"2024-04-25T11:05:24.810629+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:24.810629+0000","last_undegraded":"2024-04-25T11:05:24.810629+0000","last_fullsized":"2024-04-25T11:05:24.810629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.793146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1939","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.869142+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T11:05:29.869142+0000","last_peered":"2024-04-25T11:05:29.869142+0000","last_clean":"2024-04-25T11:05:29.869142+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:29.869142+0000","last_undegraded":"2024-04-25T11:05:29.869142+0000","last_fullsized":"2024-04-25T11:05:29.869142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1939,"log_dups_size":0,"ondisk_log_size":1939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1836","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.933110+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T11:05:24.933110+0000","last_peered":"2024-04-25T11:05:24.933110+0000","last_clean":"2024-04-25T11:05:24.933110+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:24.933110+0000","last_undegraded":"2024-04-25T11:05:24.933110+0000","last_fullsized":"2024-04-25T11:05:24.933110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1929","reported_seq":1966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.770648+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T11:05:24.770648+0000","last_peered":"2024-04-25T11:05:24.770648+0000","last_clean":"2024-04-25T11:05:24.770648+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:24.770648+0000","last_undegraded":"2024-04-25T11:05:24.770648+0000","last_fullsized":"2024-04-25T11:05:24.770648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1929,"log_dups_size":0,"ondisk_log_size":1929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1914","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.825546+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T11:05:29.825546+0000","last_peered":"2024-04-25T11:05:29.825546+0000","last_clean":"2024-04-25T11:05:29.825546+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:29.825546+0000","last_undegraded":"2024-04-25T11:05:29.825546+0000","last_fullsized":"2024-04-25T11:05:29.825546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1866","reported_seq":1904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.892733+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T11:05:24.892733+0000","last_peered":"2024-04-25T11:05:24.892733+0000","last_clean":"2024-04-25T11:05:24.892733+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:24.892733+0000","last_undegraded":"2024-04-25T11:05:24.892733+0000","last_fullsized":"2024-04-25T11:05:24.892733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1909","reported_seq":1945,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.836710+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T11:05:29.836710+0000","last_peered":"2024-04-25T11:05:29.836710+0000","last_clean":"2024-04-25T11:05:29.836710+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:29.836710+0000","last_undegraded":"2024-04-25T11:05:29.836710+0000","last_fullsized":"2024-04-25T11:05:29.836710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1912","reported_seq":1949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.613474+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T11:05:24.613474+0000","last_peered":"2024-04-25T11:05:24.613474+0000","last_clean":"2024-04-25T11:05:24.613474+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:24.613474+0000","last_undegraded":"2024-04-25T11:05:24.613474+0000","last_fullsized":"2024-04-25T11:05:24.613474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1912","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.320027+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T11:05:24.320027+0000","last_peered":"2024-04-25T11:05:24.320027+0000","last_clean":"2024-04-25T11:05:24.320027+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:24.320027+0000","last_undegraded":"2024-04-25T11:05:24.320027+0000","last_fullsized":"2024-04-25T11:05:24.320027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1892","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.461976+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T11:05:24.461976+0000","last_peered":"2024-04-25T11:05:24.461976+0000","last_clean":"2024-04-25T11:05:24.461976+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:24.461976+0000","last_undegraded":"2024-04-25T11:05:24.461976+0000","last_fullsized":"2024-04-25T11:05:24.461976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1948","reported_seq":1984,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862095+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T11:05:24.862095+0000","last_peered":"2024-04-25T11:05:24.862095+0000","last_clean":"2024-04-25T11:05:24.862095+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:24.862095+0000","last_undegraded":"2024-04-25T11:05:24.862095+0000","last_fullsized":"2024-04-25T11:05:24.862095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1846","reported_seq":1883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.808441+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T11:05:24.808441+0000","last_peered":"2024-04-25T11:05:24.808441+0000","last_clean":"2024-04-25T11:05:24.808441+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:24.808441+0000","last_undegraded":"2024-04-25T11:05:24.808441+0000","last_fullsized":"2024-04-25T11:05:24.808441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1846,"log_dups_size":0,"ondisk_log_size":1846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1896","reported_seq":1933,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.609612+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T11:05:24.609612+0000","last_peered":"2024-04-25T11:05:24.609612+0000","last_clean":"2024-04-25T11:05:24.609612+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:24.609612+0000","last_undegraded":"2024-04-25T11:05:24.609612+0000","last_fullsized":"2024-04-25T11:05:24.609612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.405186+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T11:05:24.405186+0000","last_peered":"2024-04-25T11:05:24.405186+0000","last_clean":"2024-04-25T11:05:24.405186+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:24.405186+0000","last_undegraded":"2024-04-25T11:05:24.405186+0000","last_fullsized":"2024-04-25T11:05:24.405186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1945","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.340631+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T11:05:24.340631+0000","last_peered":"2024-04-25T11:05:24.340631+0000","last_clean":"2024-04-25T11:05:24.340631+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:24.340631+0000","last_undegraded":"2024-04-25T11:05:24.340631+0000","last_fullsized":"2024-04-25T11:05:24.340631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1852","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.060978+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T11:05:24.060978+0000","last_peered":"2024-04-25T11:05:24.060978+0000","last_clean":"2024-04-25T11:05:24.060978+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:24.060978+0000","last_undegraded":"2024-04-25T11:05:24.060978+0000","last_fullsized":"2024-04-25T11:05:24.060978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1875","reported_seq":1911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.847978+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T11:05:29.847978+0000","last_peered":"2024-04-25T11:05:29.847978+0000","last_clean":"2024-04-25T11:05:29.847978+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:29.847978+0000","last_undegraded":"2024-04-25T11:05:29.847978+0000","last_fullsized":"2024-04-25T11:05:29.847978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1806","reported_seq":1842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.741424+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T11:05:24.741424+0000","last_peered":"2024-04-25T11:05:24.741424+0000","last_clean":"2024-04-25T11:05:24.741424+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:24.741424+0000","last_undegraded":"2024-04-25T11:05:24.741424+0000","last_fullsized":"2024-04-25T11:05:24.741424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1826","reported_seq":1861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.596582+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T11:05:24.596582+0000","last_peered":"2024-04-25T11:05:24.596582+0000","last_clean":"2024-04-25T11:05:24.596582+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:24.596582+0000","last_undegraded":"2024-04-25T11:05:24.596582+0000","last_fullsized":"2024-04-25T11:05:24.596582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1933","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.426459+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T11:05:24.426459+0000","last_peered":"2024-04-25T11:05:24.426459+0000","last_clean":"2024-04-25T11:05:24.426459+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:24.426459+0000","last_undegraded":"2024-04-25T11:05:24.426459+0000","last_fullsized":"2024-04-25T11:05:24.426459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1916","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.619270+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T11:05:24.619270+0000","last_peered":"2024-04-25T11:05:24.619270+0000","last_clean":"2024-04-25T11:05:24.619270+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:24.619270+0000","last_undegraded":"2024-04-25T11:05:24.619270+0000","last_fullsized":"2024-04-25T11:05:24.619270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1889","reported_seq":1924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857513+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T11:05:29.857513+0000","last_peered":"2024-04-25T11:05:29.857513+0000","last_clean":"2024-04-25T11:05:29.857513+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:29.857513+0000","last_undegraded":"2024-04-25T11:05:29.857513+0000","last_fullsized":"2024-04-25T11:05:29.857513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1847","reported_seq":1882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.751345+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T11:05:24.751345+0000","last_peered":"2024-04-25T11:05:24.751345+0000","last_clean":"2024-04-25T11:05:24.751345+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:24.751345+0000","last_undegraded":"2024-04-25T11:05:24.751345+0000","last_fullsized":"2024-04-25T11:05:24.751345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1816","reported_seq":1852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.374622+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T11:05:24.374622+0000","last_peered":"2024-04-25T11:05:24.374622+0000","last_clean":"2024-04-25T11:05:24.374622+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:24.374622+0000","last_undegraded":"2024-04-25T11:05:24.374622+0000","last_fullsized":"2024-04-25T11:05:24.374622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1913","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.717041+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T11:05:24.717041+0000","last_peered":"2024-04-25T11:05:24.717041+0000","last_clean":"2024-04-25T11:05:24.717041+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:24.717041+0000","last_undegraded":"2024-04-25T11:05:24.717041+0000","last_fullsized":"2024-04-25T11:05:24.717041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1931","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.513194+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T11:05:24.513194+0000","last_peered":"2024-04-25T11:05:24.513194+0000","last_clean":"2024-04-25T11:05:24.513194+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:24.513194+0000","last_undegraded":"2024-04-25T11:05:24.513194+0000","last_fullsized":"2024-04-25T11:05:24.513194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1971","reported_seq":2008,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810713+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T11:05:24.810713+0000","last_peered":"2024-04-25T11:05:24.810713+0000","last_clean":"2024-04-25T11:05:24.810713+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:24.810713+0000","last_undegraded":"2024-04-25T11:05:24.810713+0000","last_fullsized":"2024-04-25T11:05:24.810713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1842","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.860274+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T11:05:24.860274+0000","last_peered":"2024-04-25T11:05:24.860274+0000","last_clean":"2024-04-25T11:05:24.860274+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:24.860274+0000","last_undegraded":"2024-04-25T11:05:24.860274+0000","last_fullsized":"2024-04-25T11:05:24.860274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.562050+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T11:05:24.562050+0000","last_peered":"2024-04-25T11:05:24.562050+0000","last_clean":"2024-04-25T11:05:24.562050+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:24.562050+0000","last_undegraded":"2024-04-25T11:05:24.562050+0000","last_fullsized":"2024-04-25T11:05:24.562050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":49853355,"num_objects":147,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151410,"num_write_kb":4113589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8327168,"data_stored":104034304,"data_compressed":4885725,"data_compressed_allocated":6918144,"data_compressed_original":102625280,"omap_allocated":0,"internal_metadata":0},"log_size":212556,"ondisk_log_size":212556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120899,"ondisk_log_size":120899,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241689131,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":2748,"num_read_kb":14559,"num_write":146323,"num_write_kb":1170633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304422912,"data_stored":483899944,"data_compressed":55688673,"data_compressed_allocated":82096128,"data_compressed_original":261730304,"omap_allocated":0,"internal_metadata":0},"log_size":143023,"ondisk_log_size":143023,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575172,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753492,"kb_used_data":36492,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":93618348,"statfs":{"total":96636764160,"available":95865188352,"internally_reserved":0,"allocated":37367808,"data_stored":67646759,"data_compressed":6585493,"data_compressed_allocated":9887744,"data_compressed_original":40366080,"omap_allocated":1590,"internal_metadata":734198218},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":802736,"kb_used_data":53864,"kb_used_omap":1,"kb_used_meta":748862,"kb_avail":93569104,"statfs":{"total":96636764160,"available":95814762496,"internally_reserved":0,"allocated":55156736,"data_stored":99435836,"data_compressed":10470818,"data_compressed_allocated":15323136,"data_compressed_original":59797504,"omap_allocated":1594,"internal_metadata":766835142},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":758200,"kb_used_data":37232,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93613640,"statfs":{"total":96636764160,"available":95860367360,"internally_reserved":0,"allocated":38125568,"data_stored":72536643,"data_compressed":7445444,"data_compressed_allocated":10952704,"data_compressed_original":45559808,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":741016,"kb_used_data":42192,"kb_used_omap":1,"kb_used_meta":698814,"kb_avail":93630824,"statfs":{"total":96636764160,"available":95877963776,"internally_reserved":0,"allocated":43204608,"data_stored":75600045,"data_compressed":8104813,"data_compressed_allocated":11968512,"data_compressed_original":44556288,"omap_allocated":1594,"internal_metadata":715585990},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838908,"kb_used_data":63796,"kb_used_omap":1,"kb_used_meta":775102,"kb_avail":93532932,"statfs":{"total":96636764160,"available":95777722368,"internally_reserved":0,"allocated":65327104,"data_stored":115587848,"data_compressed":12603349,"data_compressed_allocated":18350080,"data_compressed_original":68808704,"omap_allocated":1593,"internal_metadata":793704903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":480720,"kb_used_data":26176,"kb_used_omap":1,"kb_used_meta":454526,"kb_avail":93891120,"statfs":{"total":96636764160,"available":96144506880,"internally_reserved":0,"allocated":26804224,"data_stored":56565779,"data_compressed":5629800,"data_compressed_allocated":8048640,"data_compressed_original":38006784,"omap_allocated":1595,"internal_metadata":465435077},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":819992,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":797374,"kb_avail":93551848,"statfs":{"total":96636764160,"available":95797092352,"internally_reserved":0,"allocated":23150592,"data_stored":52524293,"data_compressed":4801697,"data_compressed_allocated":7024640,"data_compressed_original":36601856,"omap_allocated":1595,"internal_metadata":816511429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569980,"kb_used_data":25332,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93801860,"statfs":{"total":96636764160,"available":96053104640,"internally_reserved":0,"allocated":25939968,"data_stored":50934165,"data_compressed":4989204,"data_compressed_allocated":7450624,"data_compressed_original":32641024,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21426176,"data_stored":34080905,"data_compressed":3940012,"data_compressed_allocated":5824512,"data_compressed_original":18505728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64053248,"data_stored":103270338,"data_compressed":12080873,"data_compressed_allocated":17604608,"data_compressed_original":56844288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109836,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53874688,"data_stored":86496451,"data_compressed":9867858,"data_compressed_allocated":14471168,"data_compressed_original":47112192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527526,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":970752,"data_stored":12468224,"data_compressed":586137,"data_compressed_allocated":823296,"data_compressed_original":12320768,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":18317312,"data_compressed":861685,"data_compressed_allocated":1200128,"data_compressed_original":18096128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":10649600,"data_compressed":500746,"data_compressed_allocated":696320,"data_compressed_original":10522624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1474560,"data_stored":15327232,"data_compressed":714334,"data_compressed_allocated":1089536,"data_compressed_original":14942208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":8364032,"data_compressed":393015,"data_compressed_allocated":552960,"data_compressed_original":8228864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":13688832,"data_compressed":643834,"data_compressed_allocated":892928,"data_compressed_original":13565952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":12816384,"data_compressed":602960,"data_compressed_allocated":851968,"data_compressed_original":12685312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":12402688,"data_compressed":583014,"data_compressed_allocated":811008,"data_compressed_original":12263424,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:05:30.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:05:30.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.985+0000 7fcf27e00640 1 Processor -- start 2024-04-25T11:05:30.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.985+0000 7fcf27e00640 1 -- start start 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf27e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcf280705b0 0x7fcf280709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf27e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf280c5100 con 0x7fcf280ca3d0 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf27e00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf28159910 con 0x7fcf280c0590 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf27e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fcf2815a490 con 0x7fcf280705b0 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf26a00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fcf280c0590 0x7fcf28153710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:48568/0 (socket says 172.21.15.16:48568) 2024-04-25T11:05:30.991 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf26a00640 1 -- 172.21.15.16:0/944092204 learned_addr learned my addr 172.21.15.16:0/944092204 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139192494 0 0) 0x7fcf28159910 con 0x7fcf280c0590 2024-04-25T11:05:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf0c0035c0 con 0x7fcf280c0590 2024-04-25T11:05:30.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf26000640 1 --2- 172.21.15.16:0/944092204 >> v2:172.21.15.16:3300/0 conn(0x7fcf280705b0 0x7fcf280709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 298619004 0 0) 0x7fcf0c0035c0 con 0x7fcf280c0590 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 >> v2:172.21.15.16:3300/0 conn(0x7fcf280705b0 msgr2=0x7fcf280709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 --2- 172.21.15.16:0/944092204 >> v2:172.21.15.16:3300/0 conn(0x7fcf280705b0 0x7fcf280709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 >> v1:172.21.15.16:6789/0 conn(0x7fcf280ca3d0 legacy=0x7fcf280c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf28159bf0 con 0x7fcf280c0590 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fcf180016d0 con 0x7fcf280c0590 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 >> v1:172.21.15.186:6789/0 conn(0x7fcf280c0590 legacy=0x7fcf28153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf0c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c0048a0 0x7fcf0c004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0052f0 0x7fcf0c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:30.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815a490 con 0x7fcf0c003aa0 2024-04-25T11:05:30.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0c00c270 con 0x7fcf0c0048a0 2024-04-25T11:05:30.994 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcf0c00c470 con 0x7fcf0c0052f0 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf26a00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf0c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf27400640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0052f0 0x7fcf0c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.989+0000 7fcf26000640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c0048a0 0x7fcf0c004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26a00640 1 -- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0052f0 msgr2=0x7fcf0c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26a00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0052f0 0x7fcf0c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26a00640 1 -- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c0048a0 msgr2=0x7fcf0c004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26a00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c0048a0 0x7fcf0c004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26a00640 1 -- 172.21.15.16:0/944092204 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0c0035c0 con 0x7fcf0c003aa0 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf27400640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf0c0052f0 0x7fcf0c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf26000640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf0c0048a0 0x7fcf0c004cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:30.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.993+0000 7fcf27400640 1 -- 172.21.15.16:0/944092204 reap_dead start 2024-04-25T11:05:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf26a00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf0c003eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800c250 tx=0x7fcf1801f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743879647e734402 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18007d80 con 0x7fcf0c003aa0 2024-04-25T11:05:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf18005b20 con 0x7fcf0c003aa0 2024-04-25T11:05:31.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf25600640 1 -- 172.21.15.16:0/944092204 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18007070 con 0x7fcf0c003aa0 2024-04-25T11:05:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf27e00640 1 -- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 msgr2=0x7fcf0c003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.001 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf27e00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf0c003eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800c250 tx=0x7fcf1801f430 comp rx=0 tx=0).stop 2024-04-25T11:05:31.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf27e00640 1 -- 172.21.15.16:0/944092204 shutdown_connections 2024-04-25T11:05:31.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf27e00640 1 --2- 172.21.15.16:0/944092204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf0c003eb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:30.997+0000 7fcf27e00640 1 -- 172.21.15.16:0/944092204 >> 172.21.15.16:0/944092204 conn(0x7fcf280cd950 msgr2=0x7fcf280c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:31.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.001+0000 7fcf27e00640 1 -- 172.21.15.16:0/944092204 shutdown_connections 2024-04-25T11:05:31.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.001+0000 7fcf27e00640 1 -- 172.21.15.16:0/944092204 wait complete. 2024-04-25T11:05:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.001+0000 7fcf27e00640 1 Processor -- start 2024-04-25T11:05:31.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.001+0000 7fcf27e00640 1 -- start start 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf280c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf28156bd0 0x7fcf28145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fcf280c54e0 con 0x7fcf0c003aa0 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2815a1b0 con 0x7fcf28156bd0 2024-04-25T11:05:31.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcf280c09a0 con 0x7fcf281567c0 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:46762/0 (socket says 172.21.15.16:46762) 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 -- 172.21.15.16:0/2592468955 learned_addr learned my addr 172.21.15.16:0/2592468955 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf27400640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf28156bd0 0x7fcf28145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26a00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf280c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 -- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf28156bd0 msgr2=0x7fcf28145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf28156bd0 0x7fcf28145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 -- 172.21.15.16:0/2592468955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 msgr2=0x7fcf280c1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf280c1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 -- 172.21.15.16:0/2592468955 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf28159300 con 0x7fcf281567c0 2024-04-25T11:05:31.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.005+0000 7fcf26000640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf140108c0 tx=0x7fcf14010d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400e030 con 0x7fcf281567c0 2024-04-25T11:05:31.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf14004440 con 0x7fcf281567c0 2024-04-25T11:05:31.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1400f040 con 0x7fcf281567c0 2024-04-25T11:05:31.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf280c1990 con 0x7fcf281567c0 2024-04-25T11:05:31.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf28154630 con 0x7fcf281567c0 2024-04-25T11:05:31.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf281540e0 con 0x7fcf281567c0 2024-04-25T11:05:31.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.009+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcf1400c9d0 con 0x7fcf281567c0 2024-04-25T11:05:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.013+0000 7fcf1ea00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 0x7fcf00071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.013+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fcf1408fb90 con 0x7fcf281567c0 2024-04-25T11:05:31.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.013+0000 7fcf26a00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 0x7fcf00071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.017+0000 7fcf26a00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 0x7fcf00071ae0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf18007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.017+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcf1405bfe0 con 0x7fcf281567c0 2024-04-25T11:05:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.337+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcf280c1c60 con 0x7fcf0006f5d0 2024-04-25T11:05:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.345+0000 7fcf1ea00640 1 -- 172.21.15.16:0/2592468955 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336376 (secure 0 0 0) 0x7fcf280c1c60 con 0x7fcf0006f5d0 2024-04-25T11:05:31.352 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:31.354 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:05:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 msgr2=0x7fcf00071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 0x7fcf00071ae0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf18007040 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 msgr2=0x7fcf2813d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf140108c0 tx=0x7fcf14010d80 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 shutdown_connections 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fcf0006f5d0 0x7fcf00071ae0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcf28156bd0 0x7fcf28145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcf281567c0 0x7fcf2813d4b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 --2- 172.21.15.16:0/2592468955 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcf0c003aa0 0x7fcf280c1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 >> 172.21.15.16:0/2592468955 conn(0x7fcf280cd950 msgr2=0x7fcf28158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 shutdown_connections 2024-04-25T11:05:31.356 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.349+0000 7fcf27e00640 1 -- 172.21.15.16:0/2592468955 wait complete. 2024-04-25T11:05:31.373 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":824,"stamp":"2024-04-25T11:05:30.355126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292132854,"num_objects":453,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":7927,"num_read_kb":1313316,"num_write":298873,"num_write_kb":5285850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476550,"ondisk_log_size":476550,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5765044,"kb_used_data":307692,"kb_used_omap":12,"kb_used_meta":5457267,"kb_avail":749209676,"statfs":{"total":773094113280,"available":767190708224,"internally_reserved":0,"allocated":315076608,"data_stored":590831368,"data_compressed":60630618,"data_compressed_allocated":89006080,"data_compressed_original":366338048,"omap_allocated":12751,"internal_metadata":5588241969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,3,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-194504316,"num_objects":-1545,"num_object_clones":0,"num_object_copies":-5210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1545,"num_whiteouts":0,"num_read":25,"num_read_kb":3165,"num_write":2992,"num_write_kb":35827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004634"},"pg_stats":[{"pgid":"2.1f","version":"28'1879","reported_seq":1918,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:01:56.663229+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T11:01:56.663229+0000","last_peered":"2024-04-25T11:01:56.663229+0000","last_clean":"2024-04-25T11:01:56.663229+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:01:56.663229+0000","last_undegraded":"2024-04-25T11:01:56.663229+0000","last_fullsized":"2024-04-25T11:01:56.663229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1893,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1893","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857863+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T11:05:29.857863+0000","last_peered":"2024-04-25T11:05:29.857863+0000","last_clean":"2024-04-25T11:05:29.857863+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:29.857863+0000","last_undegraded":"2024-04-25T11:05:29.857863+0000","last_fullsized":"2024-04-25T11:05:29.857863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6388","reported_seq":6461,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.602400+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T11:05:29.602400+0000","last_peered":"2024-04-25T11:05:29.602400+0000","last_clean":"2024-04-25T11:05:29.602400+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:29.602400+0000","last_undegraded":"2024-04-25T11:05:29.602400+0000","last_fullsized":"2024-04-25T11:05:29.602400+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23133,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4423,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4891","reported_seq":4931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.612083+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T11:05:27.612083+0000","last_peered":"2024-04-25T11:05:27.612083+0000","last_clean":"2024-04-25T11:05:27.612083+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:27.612083+0000","last_undegraded":"2024-04-25T11:05:27.612083+0000","last_fullsized":"2024-04-25T11:05:27.612083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1892","reported_seq":1929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.554231+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T11:05:24.554231+0000","last_peered":"2024-04-25T11:05:24.554231+0000","last_clean":"2024-04-25T11:05:24.554231+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:24.554231+0000","last_undegraded":"2024-04-25T11:05:24.554231+0000","last_fullsized":"2024-04-25T11:05:24.554231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6747","reported_seq":6875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.976907+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T11:05:24.976907+0000","last_peered":"2024-04-25T11:05:24.976907+0000","last_clean":"2024-04-25T11:05:24.976907+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:24.976907+0000","last_undegraded":"2024-04-25T11:05:24.976907+0000","last_fullsized":"2024-04-25T11:05:24.976907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6747,"log_dups_size":0,"ondisk_log_size":6747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640448,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4751,"num_write_kb":130705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7161","reported_seq":7198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:12.813758+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T11:05:12.813758+0000","last_peered":"2024-04-25T11:05:12.813758+0000","last_clean":"2024-04-25T11:05:12.813758+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:12.813758+0000","last_undegraded":"2024-04-25T11:05:12.813758+0000","last_fullsized":"2024-04-25T11:05:12.813758+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7162,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1932","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635183+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T11:05:24.635183+0000","last_peered":"2024-04-25T11:05:24.635183+0000","last_clean":"2024-04-25T11:05:24.635183+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:24.635183+0000","last_undegraded":"2024-04-25T11:05:24.635183+0000","last_fullsized":"2024-04-25T11:05:24.635183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6457","reported_seq":6673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.734570+0000","last_change":"2024-04-25T10:39:39.057558+0000","last_active":"2024-04-25T11:05:24.734570+0000","last_peered":"2024-04-25T11:05:24.734570+0000","last_clean":"2024-04-25T11:05:24.734570+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:24.734570+0000","last_undegraded":"2024-04-25T11:05:24.734570+0000","last_fullsized":"2024-04-25T11:05:24.734570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6457,"log_dups_size":0,"ondisk_log_size":6457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4420,"num_write_kb":116213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3801","reported_seq":3838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.537738+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T11:05:08.537738+0000","last_peered":"2024-04-25T11:05:08.537738+0000","last_clean":"2024-04-25T11:05:08.537738+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:08.537738+0000","last_undegraded":"2024-04-25T11:05:08.537738+0000","last_fullsized":"2024-04-25T11:05:08.537738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3804,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1878","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.030107+0000","last_change":"2024-04-25T10:39:38.922901+0000","last_active":"2024-04-25T11:05:24.030107+0000","last_peered":"2024-04-25T11:05:24.030107+0000","last_clean":"2024-04-25T11:05:24.030107+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:24.030107+0000","last_undegraded":"2024-04-25T11:05:24.030107+0000","last_fullsized":"2024-04-25T11:05:24.030107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6614","reported_seq":6735,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.655131+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T11:05:24.655131+0000","last_peered":"2024-04-25T11:05:24.655131+0000","last_clean":"2024-04-25T11:05:24.655131+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:24.655131+0000","last_undegraded":"2024-04-25T11:05:24.655131+0000","last_fullsized":"2024-04-25T11:05:24.655131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6614,"log_dups_size":0,"ondisk_log_size":6614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":937291,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4650,"num_write_kb":122056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1909","reported_seq":1946,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.856637+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T11:05:24.856637+0000","last_peered":"2024-04-25T11:05:24.856637+0000","last_clean":"2024-04-25T11:05:24.856637+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:24.856637+0000","last_undegraded":"2024-04-25T11:05:24.856637+0000","last_fullsized":"2024-04-25T11:05:24.856637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5501","reported_seq":5539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:45.406535+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T11:03:45.406535+0000","last_peered":"2024-04-25T11:03:45.406535+0000","last_clean":"2024-04-25T11:03:45.406535+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:03:45.406535+0000","last_undegraded":"2024-04-25T11:03:45.406535+0000","last_fullsized":"2024-04-25T11:03:45.406535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5501,"log_dups_size":0,"ondisk_log_size":5501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5518,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6767","reported_seq":6845,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.942115+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T11:05:24.942115+0000","last_peered":"2024-04-25T11:05:24.942115+0000","last_clean":"2024-04-25T11:05:24.942115+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:24.942115+0000","last_undegraded":"2024-04-25T11:05:24.942115+0000","last_fullsized":"2024-04-25T11:05:24.942115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6767,"log_dups_size":0,"ondisk_log_size":6767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83190,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4710,"num_write_kb":126882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1919","reported_seq":1955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857498+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T11:05:29.857498+0000","last_peered":"2024-04-25T11:05:29.857498+0000","last_clean":"2024-04-25T11:05:29.857498+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:29.857498+0000","last_undegraded":"2024-04-25T11:05:29.857498+0000","last_fullsized":"2024-04-25T11:05:29.857498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4960","reported_seq":5000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:13.419386+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T11:04:13.419386+0000","last_peered":"2024-04-25T11:04:13.419386+0000","last_clean":"2024-04-25T11:04:13.419386+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:04:13.419386+0000","last_undegraded":"2024-04-25T11:04:13.419386+0000","last_fullsized":"2024-04-25T11:04:13.419386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4959,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7052","reported_seq":7152,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914288+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T11:05:24.914288+0000","last_peered":"2024-04-25T11:05:24.914288+0000","last_clean":"2024-04-25T11:05:24.914288+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:24.914288+0000","last_undegraded":"2024-04-25T11:05:24.914288+0000","last_fullsized":"2024-04-25T11:05:24.914288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5087,"num_write_kb":139955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1950","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.851278+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T11:05:29.851278+0000","last_peered":"2024-04-25T11:05:29.851278+0000","last_clean":"2024-04-25T11:05:29.851278+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:29.851278+0000","last_undegraded":"2024-04-25T11:05:29.851278+0000","last_fullsized":"2024-04-25T11:05:29.851278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1950,"log_dups_size":0,"ondisk_log_size":1950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2275","reported_seq":2315,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:54.070815+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T11:03:54.070815+0000","last_peered":"2024-04-25T11:03:54.070815+0000","last_clean":"2024-04-25T11:03:54.070815+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:03:54.070815+0000","last_undegraded":"2024-04-25T11:03:54.070815+0000","last_fullsized":"2024-04-25T11:03:54.070815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2275,"log_dups_size":0,"ondisk_log_size":2275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2283,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6667","reported_seq":6810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.721941+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T11:05:24.721941+0000","last_peered":"2024-04-25T11:05:24.721941+0000","last_clean":"2024-04-25T11:05:24.721941+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:24.721941+0000","last_undegraded":"2024-04-25T11:05:24.721941+0000","last_fullsized":"2024-04-25T11:05:24.721941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6667,"log_dups_size":0,"ondisk_log_size":6667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4759,"num_write_kb":122782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1930","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.439676+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T11:05:24.439676+0000","last_peered":"2024-04-25T11:05:24.439676+0000","last_clean":"2024-04-25T11:05:24.439676+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:24.439676+0000","last_undegraded":"2024-04-25T11:05:24.439676+0000","last_fullsized":"2024-04-25T11:05:24.439676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1616","reported_seq":1655,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:54.280349+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T11:04:54.280349+0000","last_peered":"2024-04-25T11:04:54.280349+0000","last_clean":"2024-04-25T11:04:54.280349+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:04:54.280349+0000","last_undegraded":"2024-04-25T11:04:54.280349+0000","last_fullsized":"2024-04-25T11:04:54.280349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1627,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7407","reported_seq":7508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.824089+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T11:05:24.824089+0000","last_peered":"2024-04-25T11:05:24.824089+0000","last_clean":"2024-04-25T11:05:24.824089+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:24.824089+0000","last_undegraded":"2024-04-25T11:05:24.824089+0000","last_fullsized":"2024-04-25T11:05:24.824089+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5357,"num_write_kb":119171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.698283+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T11:05:24.698283+0000","last_peered":"2024-04-25T11:05:24.698283+0000","last_clean":"2024-04-25T11:05:24.698283+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:24.698283+0000","last_undegraded":"2024-04-25T11:05:24.698283+0000","last_fullsized":"2024-04-25T11:05:24.698283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2472","reported_seq":2511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.217363+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T11:04:08.217363+0000","last_peered":"2024-04-25T11:04:08.217363+0000","last_clean":"2024-04-25T11:04:08.217363+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:04:08.217363+0000","last_undegraded":"2024-04-25T11:04:08.217363+0000","last_fullsized":"2024-04-25T11:04:08.217363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2472,"log_dups_size":0,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2498,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6585","reported_seq":6690,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.773668+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T11:05:24.773668+0000","last_peered":"2024-04-25T11:05:24.773668+0000","last_clean":"2024-04-25T11:05:24.773668+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:24.773668+0000","last_undegraded":"2024-04-25T11:05:24.773668+0000","last_fullsized":"2024-04-25T11:05:24.773668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4614,"num_write_kb":126370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1849","reported_seq":1886,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.868941+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T11:05:29.868941+0000","last_peered":"2024-04-25T11:05:29.868941+0000","last_clean":"2024-04-25T11:05:29.868941+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:29.868941+0000","last_undegraded":"2024-04-25T11:05:29.868941+0000","last_fullsized":"2024-04-25T11:05:29.868941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4061","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.208428+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T11:05:27.208428+0000","last_peered":"2024-04-25T11:05:27.208428+0000","last_clean":"2024-04-25T11:05:27.208428+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:27.208428+0000","last_undegraded":"2024-04-25T11:05:27.208428+0000","last_fullsized":"2024-04-25T11:05:27.208428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4061,"log_dups_size":0,"ondisk_log_size":4061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525529,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":556,"num_write":6791,"num_write_kb":36780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6491","reported_seq":6700,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617295+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T11:05:29.617295+0000","last_peered":"2024-04-25T11:05:29.617295+0000","last_clean":"2024-04-25T11:05:29.617295+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:29.617295+0000","last_undegraded":"2024-04-25T11:05:29.617295+0000","last_fullsized":"2024-04-25T11:05:29.617295+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6291,"log_dups_size":0,"ondisk_log_size":6291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751125,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4480,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1912","reported_seq":1950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.004886+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T11:05:24.004886+0000","last_peered":"2024-04-25T11:05:24.004886+0000","last_clean":"2024-04-25T11:05:24.004886+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:24.004886+0000","last_undegraded":"2024-04-25T11:05:24.004886+0000","last_fullsized":"2024-04-25T11:05:24.004886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4555","reported_seq":4594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.162006+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T11:04:08.162006+0000","last_peered":"2024-04-25T11:04:08.162006+0000","last_clean":"2024-04-25T11:04:08.162006+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:04:08.162006+0000","last_undegraded":"2024-04-25T11:04:08.162006+0000","last_fullsized":"2024-04-25T11:04:08.162006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4555,"log_dups_size":0,"ondisk_log_size":4555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4566,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7267","reported_seq":7517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.955878+0000","last_change":"2024-04-25T10:39:39.090203+0000","last_active":"2024-04-25T11:05:24.955878+0000","last_peered":"2024-04-25T11:05:24.955878+0000","last_clean":"2024-04-25T11:05:24.955878+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:24.955878+0000","last_undegraded":"2024-04-25T11:05:24.955878+0000","last_fullsized":"2024-04-25T11:05:24.955878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7267,"log_dups_size":0,"ondisk_log_size":7267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3488000,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5258,"num_write_kb":158271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1885","reported_seq":1923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.783599+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T11:05:24.783599+0000","last_peered":"2024-04-25T11:05:24.783599+0000","last_clean":"2024-04-25T11:05:24.783599+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:24.783599+0000","last_undegraded":"2024-04-25T11:05:24.783599+0000","last_fullsized":"2024-04-25T11:05:24.783599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4320","reported_seq":4360,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:03.302219+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T11:05:03.302219+0000","last_peered":"2024-04-25T11:05:03.302219+0000","last_clean":"2024-04-25T11:05:03.302219+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:03.302219+0000","last_undegraded":"2024-04-25T11:05:03.302219+0000","last_fullsized":"2024-04-25T11:05:03.302219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4326,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7443","reported_seq":7736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.621494+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T11:05:24.621494+0000","last_peered":"2024-04-25T11:05:24.621494+0000","last_clean":"2024-04-25T11:05:24.621494+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:24.621494+0000","last_undegraded":"2024-04-25T11:05:24.621494+0000","last_fullsized":"2024-04-25T11:05:24.621494+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7343,"log_dups_size":0,"ondisk_log_size":7343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4627106,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5425,"num_write_kb":156322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1901","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.961767+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T11:05:24.961767+0000","last_peered":"2024-04-25T11:05:24.961767+0000","last_clean":"2024-04-25T11:05:24.961767+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:24.961767+0000","last_undegraded":"2024-04-25T11:05:24.961767+0000","last_fullsized":"2024-04-25T11:05:24.961767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5566","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:07.927173+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T11:03:07.927173+0000","last_peered":"2024-04-25T11:03:07.927173+0000","last_clean":"2024-04-25T11:03:07.927173+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:03:07.927173+0000","last_undegraded":"2024-04-25T11:03:07.927173+0000","last_fullsized":"2024-04-25T11:03:07.927173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5566,"log_dups_size":0,"ondisk_log_size":5566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5571,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6953","reported_seq":7026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.838139+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T11:05:24.838139+0000","last_peered":"2024-04-25T11:05:24.838139+0000","last_clean":"2024-04-25T11:05:24.838139+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:24.838139+0000","last_undegraded":"2024-04-25T11:05:24.838139+0000","last_fullsized":"2024-04-25T11:05:24.838139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6953,"log_dups_size":0,"ondisk_log_size":6953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785024,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4969,"num_write_kb":146106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1903","reported_seq":1942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.409006+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T11:05:24.409006+0000","last_peered":"2024-04-25T11:05:24.409006+0000","last_clean":"2024-04-25T11:05:24.409006+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:24.409006+0000","last_undegraded":"2024-04-25T11:05:24.409006+0000","last_fullsized":"2024-04-25T11:05:24.409006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6022","reported_seq":7458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:10.103236+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T11:04:10.103236+0000","last_peered":"2024-04-25T11:04:10.103236+0000","last_clean":"2024-04-25T11:04:10.103236+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:04:10.103236+0000","last_undegraded":"2024-04-25T11:04:10.103236+0000","last_fullsized":"2024-04-25T11:04:10.103236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6022,"log_dups_size":0,"ondisk_log_size":6022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6036,"num_write_kb":43945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6540","reported_seq":7081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.886058+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T11:05:24.886058+0000","last_peered":"2024-04-25T11:05:24.886058+0000","last_clean":"2024-04-25T11:05:24.886058+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:24.886058+0000","last_undegraded":"2024-04-25T11:05:24.886058+0000","last_fullsized":"2024-04-25T11:05:24.886058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6540,"log_dups_size":0,"ondisk_log_size":6540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347382,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4571,"num_write_kb":125130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.676299+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T11:05:24.676299+0000","last_peered":"2024-04-25T11:05:24.676299+0000","last_clean":"2024-04-25T11:05:24.676299+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:24.676299+0000","last_undegraded":"2024-04-25T11:05:24.676299+0000","last_fullsized":"2024-04-25T11:05:24.676299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5526","reported_seq":5566,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:04.930461+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T11:05:04.930461+0000","last_peered":"2024-04-25T11:05:04.930461+0000","last_clean":"2024-04-25T11:05:04.930461+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:04.930461+0000","last_undegraded":"2024-04-25T11:05:04.930461+0000","last_fullsized":"2024-04-25T11:05:04.930461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5526,"log_dups_size":0,"ondisk_log_size":5526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5535,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6619","reported_seq":6739,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914010+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T11:05:24.914010+0000","last_peered":"2024-04-25T11:05:24.914010+0000","last_clean":"2024-04-25T11:05:24.914010+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:24.914010+0000","last_undegraded":"2024-04-25T11:05:24.914010+0000","last_fullsized":"2024-04-25T11:05:24.914010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6619,"log_dups_size":0,"ondisk_log_size":6619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1997569,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4568,"num_write_kb":119677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1940","reported_seq":1977,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.863204+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T11:05:29.863204+0000","last_peered":"2024-04-25T11:05:29.863204+0000","last_clean":"2024-04-25T11:05:29.863204+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:29.863204+0000","last_undegraded":"2024-04-25T11:05:29.863204+0000","last_fullsized":"2024-04-25T11:05:29.863204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3766","reported_seq":3806,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:01.058872+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T11:04:01.058872+0000","last_peered":"2024-04-25T11:04:01.058872+0000","last_clean":"2024-04-25T11:04:01.058872+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:04:01.058872+0000","last_undegraded":"2024-04-25T11:04:01.058872+0000","last_fullsized":"2024-04-25T11:04:01.058872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3779,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:55.392906+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T11:02:55.392906+0000","last_peered":"2024-04-25T11:02:55.392906+0000","last_clean":"2024-04-25T11:02:55.392906+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:02:55.392906+0000","last_undegraded":"2024-04-25T11:02:55.392906+0000","last_fullsized":"2024-04-25T11:02:55.392906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6731","reported_seq":6866,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.935024+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T11:05:24.935024+0000","last_peered":"2024-04-25T11:05:24.935024+0000","last_clean":"2024-04-25T11:05:24.935024+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:24.935024+0000","last_undegraded":"2024-04-25T11:05:24.935024+0000","last_fullsized":"2024-04-25T11:05:24.935024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6731,"log_dups_size":0,"ondisk_log_size":6731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947904,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4783,"num_write_kb":129912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1903","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.784084+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T11:05:24.784084+0000","last_peered":"2024-04-25T11:05:24.784084+0000","last_clean":"2024-04-25T11:05:24.784084+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:24.784084+0000","last_undegraded":"2024-04-25T11:05:24.784084+0000","last_fullsized":"2024-04-25T11:05:24.784084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4301","reported_seq":4340,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:17.258158+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T11:04:17.258158+0000","last_peered":"2024-04-25T11:04:17.258158+0000","last_clean":"2024-04-25T11:04:17.258158+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:04:17.258158+0000","last_undegraded":"2024-04-25T11:04:17.258158+0000","last_fullsized":"2024-04-25T11:04:17.258158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4301,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6640","reported_seq":6864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.863696+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T11:05:24.863696+0000","last_peered":"2024-04-25T11:05:24.863696+0000","last_clean":"2024-04-25T11:05:24.863696+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:24.863696+0000","last_undegraded":"2024-04-25T11:05:24.863696+0000","last_fullsized":"2024-04-25T11:05:24.863696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6640,"log_dups_size":0,"ondisk_log_size":6640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2199360,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4599,"num_write_kb":120343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1891","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.901993+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T11:05:24.901993+0000","last_peered":"2024-04-25T11:05:24.901993+0000","last_clean":"2024-04-25T11:05:24.901993+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:24.901993+0000","last_undegraded":"2024-04-25T11:05:24.901993+0000","last_fullsized":"2024-04-25T11:05:24.901993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5439","reported_seq":5478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:22.004363+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T11:03:22.004363+0000","last_peered":"2024-04-25T11:03:22.004363+0000","last_clean":"2024-04-25T11:03:22.004363+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:03:22.004363+0000","last_undegraded":"2024-04-25T11:03:22.004363+0000","last_fullsized":"2024-04-25T11:03:22.004363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5439,"log_dups_size":0,"ondisk_log_size":5439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5440,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6660","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.845436+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T11:05:24.845436+0000","last_peered":"2024-04-25T11:05:24.845436+0000","last_clean":"2024-04-25T11:05:24.845436+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:24.845436+0000","last_undegraded":"2024-04-25T11:05:24.845436+0000","last_fullsized":"2024-04-25T11:05:24.845436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6660,"log_dups_size":0,"ondisk_log_size":6660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704832,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4609,"num_write_kb":135068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1826","reported_seq":1847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.700110+0000","last_change":"2024-04-25T10:39:38.923770+0000","last_active":"2024-04-25T11:05:24.700110+0000","last_peered":"2024-04-25T11:05:24.700110+0000","last_clean":"2024-04-25T11:05:24.700110+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:24.700110+0000","last_undegraded":"2024-04-25T11:05:24.700110+0000","last_fullsized":"2024-04-25T11:05:24.700110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:27.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4831","reported_seq":4870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:21.224189+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T11:05:21.224189+0000","last_peered":"2024-04-25T11:05:21.224189+0000","last_clean":"2024-04-25T11:05:21.224189+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:21.224189+0000","last_undegraded":"2024-04-25T11:05:21.224189+0000","last_fullsized":"2024-04-25T11:05:21.224189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4831,"log_dups_size":0,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4836,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7074","reported_seq":7141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.997288+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T11:05:24.997288+0000","last_peered":"2024-04-25T11:05:24.997288+0000","last_clean":"2024-04-25T11:05:24.997288+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:24.997288+0000","last_undegraded":"2024-04-25T11:05:24.997288+0000","last_fullsized":"2024-04-25T11:05:24.997288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7074,"log_dups_size":0,"ondisk_log_size":7074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5043,"num_write_kb":119741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1915","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.501936+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T11:05:24.501936+0000","last_peered":"2024-04-25T11:05:24.501936+0000","last_clean":"2024-04-25T11:05:24.501936+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:24.501936+0000","last_undegraded":"2024-04-25T11:05:24.501936+0000","last_fullsized":"2024-04-25T11:05:24.501936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3721","reported_seq":3760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.536781+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T11:05:08.536781+0000","last_peered":"2024-04-25T11:05:08.536781+0000","last_clean":"2024-04-25T11:05:08.536781+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:08.536781+0000","last_undegraded":"2024-04-25T11:05:08.536781+0000","last_fullsized":"2024-04-25T11:05:08.536781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3721,"log_dups_size":0,"ondisk_log_size":3721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3718,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6586","reported_seq":6710,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.848846+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T11:05:24.848846+0000","last_peered":"2024-04-25T11:05:24.848846+0000","last_clean":"2024-04-25T11:05:24.848846+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:24.848846+0000","last_undegraded":"2024-04-25T11:05:24.848846+0000","last_fullsized":"2024-04-25T11:05:24.848846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6586,"log_dups_size":0,"ondisk_log_size":6586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153332,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4494,"num_write_kb":119096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1931","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.870826+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T11:05:24.870826+0000","last_peered":"2024-04-25T11:05:24.870826+0000","last_clean":"2024-04-25T11:05:24.870826+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:24.870826+0000","last_undegraded":"2024-04-25T11:05:24.870826+0000","last_fullsized":"2024-04-25T11:05:24.870826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2218","reported_seq":2257,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:41.881885+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T11:02:41.881885+0000","last_peered":"2024-04-25T11:02:41.881885+0000","last_clean":"2024-04-25T11:02:41.881885+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:02:41.881885+0000","last_undegraded":"2024-04-25T11:02:41.881885+0000","last_fullsized":"2024-04-25T11:02:41.881885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2233,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6549","reported_seq":6799,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.441422+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T11:05:24.441422+0000","last_peered":"2024-04-25T11:05:24.441422+0000","last_clean":"2024-04-25T11:05:24.441422+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:24.441422+0000","last_undegraded":"2024-04-25T11:05:24.441422+0000","last_fullsized":"2024-04-25T11:05:24.441422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778338,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4507,"num_write_kb":126341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1845","reported_seq":1881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.008456+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T11:05:25.008456+0000","last_peered":"2024-04-25T11:05:25.008456+0000","last_clean":"2024-04-25T11:05:25.008456+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:25.008456+0000","last_undegraded":"2024-04-25T11:05:25.008456+0000","last_fullsized":"2024-04-25T11:05:25.008456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1709","reported_seq":1747,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:37.187411+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T11:04:37.187411+0000","last_peered":"2024-04-25T11:04:37.187411+0000","last_clean":"2024-04-25T11:04:37.187411+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:04:37.187411+0000","last_undegraded":"2024-04-25T11:04:37.187411+0000","last_fullsized":"2024-04-25T11:04:37.187411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1713,"num_write_kb":21293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6811","reported_seq":6902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.475137+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T11:05:29.475137+0000","last_peered":"2024-04-25T11:05:29.475137+0000","last_clean":"2024-04-25T11:05:29.475137+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:29.475137+0000","last_undegraded":"2024-04-25T11:05:29.475137+0000","last_fullsized":"2024-04-25T11:05:29.475137+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2794578,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4806,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1895","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.229038+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T11:05:24.229038+0000","last_peered":"2024-04-25T11:05:24.229038+0000","last_clean":"2024-04-25T11:05:24.229038+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:24.229038+0000","last_undegraded":"2024-04-25T11:05:24.229038+0000","last_fullsized":"2024-04-25T11:05:24.229038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1895,"log_dups_size":0,"ondisk_log_size":1895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1354","reported_seq":1393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:42.358941+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T11:04:42.358941+0000","last_peered":"2024-04-25T11:04:42.358941+0000","last_clean":"2024-04-25T11:04:42.358941+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:04:42.358941+0000","last_undegraded":"2024-04-25T11:04:42.358941+0000","last_fullsized":"2024-04-25T11:04:42.358941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1360,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6430","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.528634+0000","last_change":"2024-04-25T10:39:39.093855+0000","last_active":"2024-04-25T11:05:29.528634+0000","last_peered":"2024-04-25T11:05:29.528634+0000","last_clean":"2024-04-25T11:05:29.528634+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:29.528634+0000","last_undegraded":"2024-04-25T11:05:29.528634+0000","last_fullsized":"2024-04-25T11:05:29.528634+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.407701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2247300,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4459,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1918","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.889620+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T11:05:24.889620+0000","last_peered":"2024-04-25T11:05:24.889620+0000","last_clean":"2024-04-25T11:05:24.889620+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:24.889620+0000","last_undegraded":"2024-04-25T11:05:24.889620+0000","last_fullsized":"2024-04-25T11:05:24.889620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1918,"log_dups_size":0,"ondisk_log_size":1918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3868","reported_seq":3906,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:23.139020+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T11:04:23.139020+0000","last_peered":"2024-04-25T11:04:23.139020+0000","last_clean":"2024-04-25T11:04:23.139020+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:04:23.139020+0000","last_undegraded":"2024-04-25T11:04:23.139020+0000","last_fullsized":"2024-04-25T11:04:23.139020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3868,"log_dups_size":0,"ondisk_log_size":3868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3879,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6414","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.694597+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T11:05:24.694597+0000","last_peered":"2024-04-25T11:05:24.694597+0000","last_clean":"2024-04-25T11:05:24.694597+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:24.694597+0000","last_undegraded":"2024-04-25T11:05:24.694597+0000","last_fullsized":"2024-04-25T11:05:24.694597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2392064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4464,"num_write_kb":118058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1845","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635070+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T11:05:24.635070+0000","last_peered":"2024-04-25T11:05:24.635070+0000","last_clean":"2024-04-25T11:05:24.635070+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:24.635070+0000","last_undegraded":"2024-04-25T11:05:24.635070+0000","last_fullsized":"2024-04-25T11:05:24.635070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7352","reported_seq":8015,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.342654+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T11:05:25.342654+0000","last_peered":"2024-04-25T11:05:25.342654+0000","last_clean":"2024-04-25T11:05:25.342654+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:25.342654+0000","last_undegraded":"2024-04-25T11:05:25.342654+0000","last_fullsized":"2024-04-25T11:05:25.342654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7352,"log_dups_size":0,"ondisk_log_size":7352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18861223,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7361,"num_write_kb":54825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6556","reported_seq":6620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.893573+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T11:05:24.893573+0000","last_peered":"2024-04-25T11:05:24.893573+0000","last_clean":"2024-04-25T11:05:24.893573+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:24.893573+0000","last_undegraded":"2024-04-25T11:05:24.893573+0000","last_fullsized":"2024-04-25T11:05:24.893573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6556,"log_dups_size":0,"ondisk_log_size":6556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457462,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4565,"num_write_kb":116078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.941108+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T11:05:24.941108+0000","last_peered":"2024-04-25T11:05:24.941108+0000","last_clean":"2024-04-25T11:05:24.941108+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:24.941108+0000","last_undegraded":"2024-04-25T11:05:24.941108+0000","last_fullsized":"2024-04-25T11:05:24.941108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5160","reported_seq":5198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.043331+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T11:05:23.043331+0000","last_peered":"2024-04-25T11:05:23.043331+0000","last_clean":"2024-04-25T11:05:23.043331+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:23.043331+0000","last_undegraded":"2024-04-25T11:05:23.043331+0000","last_fullsized":"2024-04-25T11:05:23.043331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5160,"log_dups_size":0,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5167,"num_write_kb":31677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6454","reported_seq":6511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.683667+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T11:05:24.683667+0000","last_peered":"2024-04-25T11:05:24.683667+0000","last_clean":"2024-04-25T11:05:24.683667+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:24.683667+0000","last_undegraded":"2024-04-25T11:05:24.683667+0000","last_fullsized":"2024-04-25T11:05:24.683667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152907,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4389,"num_write_kb":121841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1909","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.740602+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T11:05:24.740602+0000","last_peered":"2024-04-25T11:05:24.740602+0000","last_clean":"2024-04-25T11:05:24.740602+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:24.740602+0000","last_undegraded":"2024-04-25T11:05:24.740602+0000","last_fullsized":"2024-04-25T11:05:24.740602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5283","reported_seq":5321,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.192326+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T11:04:08.192326+0000","last_peered":"2024-04-25T11:04:08.192326+0000","last_clean":"2024-04-25T11:04:08.192326+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:04:08.192326+0000","last_undegraded":"2024-04-25T11:04:08.192326+0000","last_fullsized":"2024-04-25T11:04:08.192326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5288,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6496","reported_seq":6832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.606606+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T11:05:29.606606+0000","last_peered":"2024-04-25T11:05:29.606606+0000","last_clean":"2024-04-25T11:05:29.606606+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:29.606606+0000","last_undegraded":"2024-04-25T11:05:29.606606+0000","last_fullsized":"2024-04-25T11:05:29.606606+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6296,"log_dups_size":0,"ondisk_log_size":6296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406930,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4578,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1869","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.582270+0000","last_change":"2024-04-25T10:39:38.920344+0000","last_active":"2024-04-25T11:05:23.582270+0000","last_peered":"2024-04-25T11:05:23.582270+0000","last_clean":"2024-04-25T11:05:23.582270+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:23.582270+0000","last_undegraded":"2024-04-25T11:05:23.582270+0000","last_fullsized":"2024-04-25T11:05:23.582270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1869,"log_dups_size":0,"ondisk_log_size":1869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4609","reported_seq":5259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:00.879470+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T11:05:00.879470+0000","last_peered":"2024-04-25T11:05:00.879470+0000","last_clean":"2024-04-25T11:05:00.879470+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:00.879470+0000","last_undegraded":"2024-04-25T11:05:00.879470+0000","last_fullsized":"2024-04-25T11:05:00.879470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4607,"num_write_kb":39069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6794","reported_seq":7231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617793+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T11:05:29.617793+0000","last_peered":"2024-04-25T11:05:29.617793+0000","last_clean":"2024-04-25T11:05:29.617793+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:29.617793+0000","last_undegraded":"2024-04-25T11:05:29.617793+0000","last_fullsized":"2024-04-25T11:05:29.617793+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6293,"log_dups_size":0,"ondisk_log_size":6293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094726,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4765,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6711","reported_seq":6847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862188+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T11:05:24.862188+0000","last_peered":"2024-04-25T11:05:24.862188+0000","last_clean":"2024-04-25T11:05:24.862188+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:24.862188+0000","last_undegraded":"2024-04-25T11:05:24.862188+0000","last_fullsized":"2024-04-25T11:05:24.862188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6711,"log_dups_size":0,"ondisk_log_size":6711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581376,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4776,"num_write_kb":127958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1838","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.539513+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T11:05:24.539513+0000","last_peered":"2024-04-25T11:05:24.539513+0000","last_clean":"2024-04-25T11:05:24.539513+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:24.539513+0000","last_undegraded":"2024-04-25T11:05:24.539513+0000","last_fullsized":"2024-04-25T11:05:24.539513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7631","reported_seq":7669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:17.560722+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T11:05:17.560722+0000","last_peered":"2024-04-25T11:05:17.560722+0000","last_clean":"2024-04-25T11:05:17.560722+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:17.560722+0000","last_undegraded":"2024-04-25T11:05:17.560722+0000","last_fullsized":"2024-04-25T11:05:17.560722+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6425","reported_seq":6755,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.702013+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T11:05:24.702013+0000","last_peered":"2024-04-25T11:05:24.702013+0000","last_clean":"2024-04-25T11:05:24.702013+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:24.702013+0000","last_undegraded":"2024-04-25T11:05:24.702013+0000","last_fullsized":"2024-04-25T11:05:24.702013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6425,"log_dups_size":0,"ondisk_log_size":6425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4450,"num_write_kb":134560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1937","reported_seq":1972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.850546+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T11:05:29.850546+0000","last_peered":"2024-04-25T11:05:29.850546+0000","last_clean":"2024-04-25T11:05:29.850546+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:29.850546+0000","last_undegraded":"2024-04-25T11:05:29.850546+0000","last_fullsized":"2024-04-25T11:05:29.850546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3989","reported_seq":4026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:52.467207+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T11:03:52.467207+0000","last_peered":"2024-04-25T11:03:52.467207+0000","last_clean":"2024-04-25T11:03:52.467207+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:03:52.467207+0000","last_undegraded":"2024-04-25T11:03:52.467207+0000","last_fullsized":"2024-04-25T11:03:52.467207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7614","reported_seq":7651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:56.887780+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T11:04:56.887780+0000","last_peered":"2024-04-25T11:04:56.887780+0000","last_clean":"2024-04-25T11:04:56.887780+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:04:56.887780+0000","last_undegraded":"2024-04-25T11:04:56.887780+0000","last_fullsized":"2024-04-25T11:04:56.887780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7614,"log_dups_size":0,"ondisk_log_size":7614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7610,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1853","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.742622+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T11:05:23.742622+0000","last_peered":"2024-04-25T11:05:23.742622+0000","last_clean":"2024-04-25T11:05:23.742622+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:23.742622+0000","last_undegraded":"2024-04-25T11:05:23.742622+0000","last_fullsized":"2024-04-25T11:05:23.742622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6812","reported_seq":6896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.661366+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T11:05:24.661366+0000","last_peered":"2024-04-25T11:05:24.661366+0000","last_clean":"2024-04-25T11:05:24.661366+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:24.661366+0000","last_undegraded":"2024-04-25T11:05:24.661366+0000","last_fullsized":"2024-04-25T11:05:24.661366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6812,"log_dups_size":0,"ondisk_log_size":6812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700736,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4753,"num_write_kb":142652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5972","reported_seq":6009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.617686+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T11:05:27.617686+0000","last_peered":"2024-04-25T11:05:27.617686+0000","last_clean":"2024-04-25T11:05:27.617686+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:27.617686+0000","last_undegraded":"2024-04-25T11:05:27.617686+0000","last_fullsized":"2024-04-25T11:05:27.617686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1911","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.563146+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T11:05:24.563146+0000","last_peered":"2024-04-25T11:05:24.563146+0000","last_clean":"2024-04-25T11:05:24.563146+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:24.563146+0000","last_undegraded":"2024-04-25T11:05:24.563146+0000","last_fullsized":"2024-04-25T11:05:24.563146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7355","reported_seq":7908,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.565580+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T11:05:29.565580+0000","last_peered":"2024-04-25T11:05:29.565580+0000","last_clean":"2024-04-25T11:05:29.565580+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:29.565580+0000","last_undegraded":"2024-04-25T11:05:29.565580+0000","last_fullsized":"2024-04-25T11:05:29.565580+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6321,"log_dups_size":0,"ondisk_log_size":6321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964058,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5328,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1828","reported_seq":1865,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.654563+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T11:05:24.654563+0000","last_peered":"2024-04-25T11:05:24.654563+0000","last_clean":"2024-04-25T11:05:24.654563+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:24.654563+0000","last_undegraded":"2024-04-25T11:05:24.654563+0000","last_fullsized":"2024-04-25T11:05:24.654563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1931","reported_seq":1969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.766112+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T11:05:24.766112+0000","last_peered":"2024-04-25T11:05:24.766112+0000","last_clean":"2024-04-25T11:05:24.766112+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:24.766112+0000","last_undegraded":"2024-04-25T11:05:24.766112+0000","last_fullsized":"2024-04-25T11:05:24.766112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1840","reported_seq":1878,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.406515+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T11:05:24.406515+0000","last_peered":"2024-04-25T11:05:24.406515+0000","last_clean":"2024-04-25T11:05:24.406515+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:24.406515+0000","last_undegraded":"2024-04-25T11:05:24.406515+0000","last_fullsized":"2024-04-25T11:05:24.406515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1933","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810629+0000","last_change":"2024-04-25T10:39:38.921341+0000","last_active":"2024-04-25T11:05:24.810629+0000","last_peered":"2024-04-25T11:05:24.810629+0000","last_clean":"2024-04-25T11:05:24.810629+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:24.810629+0000","last_undegraded":"2024-04-25T11:05:24.810629+0000","last_fullsized":"2024-04-25T11:05:24.810629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.793146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1939","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.869142+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T11:05:29.869142+0000","last_peered":"2024-04-25T11:05:29.869142+0000","last_clean":"2024-04-25T11:05:29.869142+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:29.869142+0000","last_undegraded":"2024-04-25T11:05:29.869142+0000","last_fullsized":"2024-04-25T11:05:29.869142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1939,"log_dups_size":0,"ondisk_log_size":1939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1836","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.933110+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T11:05:24.933110+0000","last_peered":"2024-04-25T11:05:24.933110+0000","last_clean":"2024-04-25T11:05:24.933110+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:24.933110+0000","last_undegraded":"2024-04-25T11:05:24.933110+0000","last_fullsized":"2024-04-25T11:05:24.933110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1929","reported_seq":1966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.770648+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T11:05:24.770648+0000","last_peered":"2024-04-25T11:05:24.770648+0000","last_clean":"2024-04-25T11:05:24.770648+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:24.770648+0000","last_undegraded":"2024-04-25T11:05:24.770648+0000","last_fullsized":"2024-04-25T11:05:24.770648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1929,"log_dups_size":0,"ondisk_log_size":1929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1914","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.825546+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T11:05:29.825546+0000","last_peered":"2024-04-25T11:05:29.825546+0000","last_clean":"2024-04-25T11:05:29.825546+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:29.825546+0000","last_undegraded":"2024-04-25T11:05:29.825546+0000","last_fullsized":"2024-04-25T11:05:29.825546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1866","reported_seq":1904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.892733+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T11:05:24.892733+0000","last_peered":"2024-04-25T11:05:24.892733+0000","last_clean":"2024-04-25T11:05:24.892733+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:24.892733+0000","last_undegraded":"2024-04-25T11:05:24.892733+0000","last_fullsized":"2024-04-25T11:05:24.892733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1909","reported_seq":1945,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.836710+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T11:05:29.836710+0000","last_peered":"2024-04-25T11:05:29.836710+0000","last_clean":"2024-04-25T11:05:29.836710+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:29.836710+0000","last_undegraded":"2024-04-25T11:05:29.836710+0000","last_fullsized":"2024-04-25T11:05:29.836710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1912","reported_seq":1949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.613474+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T11:05:24.613474+0000","last_peered":"2024-04-25T11:05:24.613474+0000","last_clean":"2024-04-25T11:05:24.613474+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:24.613474+0000","last_undegraded":"2024-04-25T11:05:24.613474+0000","last_fullsized":"2024-04-25T11:05:24.613474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1912","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.320027+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T11:05:24.320027+0000","last_peered":"2024-04-25T11:05:24.320027+0000","last_clean":"2024-04-25T11:05:24.320027+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:24.320027+0000","last_undegraded":"2024-04-25T11:05:24.320027+0000","last_fullsized":"2024-04-25T11:05:24.320027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1892","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.461976+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T11:05:24.461976+0000","last_peered":"2024-04-25T11:05:24.461976+0000","last_clean":"2024-04-25T11:05:24.461976+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:24.461976+0000","last_undegraded":"2024-04-25T11:05:24.461976+0000","last_fullsized":"2024-04-25T11:05:24.461976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1948","reported_seq":1984,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862095+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T11:05:24.862095+0000","last_peered":"2024-04-25T11:05:24.862095+0000","last_clean":"2024-04-25T11:05:24.862095+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:24.862095+0000","last_undegraded":"2024-04-25T11:05:24.862095+0000","last_fullsized":"2024-04-25T11:05:24.862095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1846","reported_seq":1883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.808441+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T11:05:24.808441+0000","last_peered":"2024-04-25T11:05:24.808441+0000","last_clean":"2024-04-25T11:05:24.808441+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:24.808441+0000","last_undegraded":"2024-04-25T11:05:24.808441+0000","last_fullsized":"2024-04-25T11:05:24.808441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1846,"log_dups_size":0,"ondisk_log_size":1846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1896","reported_seq":1933,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.609612+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T11:05:24.609612+0000","last_peered":"2024-04-25T11:05:24.609612+0000","last_clean":"2024-04-25T11:05:24.609612+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:24.609612+0000","last_undegraded":"2024-04-25T11:05:24.609612+0000","last_fullsized":"2024-04-25T11:05:24.609612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.405186+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T11:05:24.405186+0000","last_peered":"2024-04-25T11:05:24.405186+0000","last_clean":"2024-04-25T11:05:24.405186+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:24.405186+0000","last_undegraded":"2024-04-25T11:05:24.405186+0000","last_fullsized":"2024-04-25T11:05:24.405186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1945","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.340631+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T11:05:24.340631+0000","last_peered":"2024-04-25T11:05:24.340631+0000","last_clean":"2024-04-25T11:05:24.340631+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:24.340631+0000","last_undegraded":"2024-04-25T11:05:24.340631+0000","last_fullsized":"2024-04-25T11:05:24.340631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1852","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.060978+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T11:05:24.060978+0000","last_peered":"2024-04-25T11:05:24.060978+0000","last_clean":"2024-04-25T11:05:24.060978+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:24.060978+0000","last_undegraded":"2024-04-25T11:05:24.060978+0000","last_fullsized":"2024-04-25T11:05:24.060978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1875","reported_seq":1911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.847978+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T11:05:29.847978+0000","last_peered":"2024-04-25T11:05:29.847978+0000","last_clean":"2024-04-25T11:05:29.847978+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:29.847978+0000","last_undegraded":"2024-04-25T11:05:29.847978+0000","last_fullsized":"2024-04-25T11:05:29.847978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1806","reported_seq":1842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.741424+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T11:05:24.741424+0000","last_peered":"2024-04-25T11:05:24.741424+0000","last_clean":"2024-04-25T11:05:24.741424+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:24.741424+0000","last_undegraded":"2024-04-25T11:05:24.741424+0000","last_fullsized":"2024-04-25T11:05:24.741424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1826","reported_seq":1861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.596582+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T11:05:24.596582+0000","last_peered":"2024-04-25T11:05:24.596582+0000","last_clean":"2024-04-25T11:05:24.596582+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:24.596582+0000","last_undegraded":"2024-04-25T11:05:24.596582+0000","last_fullsized":"2024-04-25T11:05:24.596582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1933","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.426459+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T11:05:24.426459+0000","last_peered":"2024-04-25T11:05:24.426459+0000","last_clean":"2024-04-25T11:05:24.426459+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:24.426459+0000","last_undegraded":"2024-04-25T11:05:24.426459+0000","last_fullsized":"2024-04-25T11:05:24.426459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1916","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.619270+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T11:05:24.619270+0000","last_peered":"2024-04-25T11:05:24.619270+0000","last_clean":"2024-04-25T11:05:24.619270+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:24.619270+0000","last_undegraded":"2024-04-25T11:05:24.619270+0000","last_fullsized":"2024-04-25T11:05:24.619270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1889","reported_seq":1924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857513+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T11:05:29.857513+0000","last_peered":"2024-04-25T11:05:29.857513+0000","last_clean":"2024-04-25T11:05:29.857513+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:29.857513+0000","last_undegraded":"2024-04-25T11:05:29.857513+0000","last_fullsized":"2024-04-25T11:05:29.857513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1847","reported_seq":1882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.751345+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T11:05:24.751345+0000","last_peered":"2024-04-25T11:05:24.751345+0000","last_clean":"2024-04-25T11:05:24.751345+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:24.751345+0000","last_undegraded":"2024-04-25T11:05:24.751345+0000","last_fullsized":"2024-04-25T11:05:24.751345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1816","reported_seq":1852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.374622+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T11:05:24.374622+0000","last_peered":"2024-04-25T11:05:24.374622+0000","last_clean":"2024-04-25T11:05:24.374622+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:24.374622+0000","last_undegraded":"2024-04-25T11:05:24.374622+0000","last_fullsized":"2024-04-25T11:05:24.374622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1913","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.717041+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T11:05:24.717041+0000","last_peered":"2024-04-25T11:05:24.717041+0000","last_clean":"2024-04-25T11:05:24.717041+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:24.717041+0000","last_undegraded":"2024-04-25T11:05:24.717041+0000","last_fullsized":"2024-04-25T11:05:24.717041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1931","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.513194+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T11:05:24.513194+0000","last_peered":"2024-04-25T11:05:24.513194+0000","last_clean":"2024-04-25T11:05:24.513194+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:24.513194+0000","last_undegraded":"2024-04-25T11:05:24.513194+0000","last_fullsized":"2024-04-25T11:05:24.513194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1971","reported_seq":2008,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810713+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T11:05:24.810713+0000","last_peered":"2024-04-25T11:05:24.810713+0000","last_clean":"2024-04-25T11:05:24.810713+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:24.810713+0000","last_undegraded":"2024-04-25T11:05:24.810713+0000","last_fullsized":"2024-04-25T11:05:24.810713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1842","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.860274+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T11:05:24.860274+0000","last_peered":"2024-04-25T11:05:24.860274+0000","last_clean":"2024-04-25T11:05:24.860274+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:24.860274+0000","last_undegraded":"2024-04-25T11:05:24.860274+0000","last_fullsized":"2024-04-25T11:05:24.860274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.562050+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T11:05:24.562050+0000","last_peered":"2024-04-25T11:05:24.562050+0000","last_clean":"2024-04-25T11:05:24.562050+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:24.562050+0000","last_undegraded":"2024-04-25T11:05:24.562050+0000","last_fullsized":"2024-04-25T11:05:24.562050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":49853355,"num_objects":147,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151410,"num_write_kb":4113589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8327168,"data_stored":104034304,"data_compressed":4885725,"data_compressed_allocated":6918144,"data_compressed_original":102625280,"omap_allocated":0,"internal_metadata":0},"log_size":212556,"ondisk_log_size":212556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120899,"ondisk_log_size":120899,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241689131,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":2748,"num_read_kb":14559,"num_write":146323,"num_write_kb":1170633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304422912,"data_stored":483899944,"data_compressed":55688673,"data_compressed_allocated":82096128,"data_compressed_original":261730304,"omap_allocated":0,"internal_metadata":0},"log_size":143023,"ondisk_log_size":143023,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575172,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753492,"kb_used_data":36492,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":93618348,"statfs":{"total":96636764160,"available":95865188352,"internally_reserved":0,"allocated":37367808,"data_stored":67646759,"data_compressed":6585493,"data_compressed_allocated":9887744,"data_compressed_original":40366080,"omap_allocated":1590,"internal_metadata":734198218},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":802736,"kb_used_data":53864,"kb_used_omap":1,"kb_used_meta":748862,"kb_avail":93569104,"statfs":{"total":96636764160,"available":95814762496,"internally_reserved":0,"allocated":55156736,"data_stored":99435836,"data_compressed":10470818,"data_compressed_allocated":15323136,"data_compressed_original":59797504,"omap_allocated":1594,"internal_metadata":766835142},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":758200,"kb_used_data":37232,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93613640,"statfs":{"total":96636764160,"available":95860367360,"internally_reserved":0,"allocated":38125568,"data_stored":72536643,"data_compressed":7445444,"data_compressed_allocated":10952704,"data_compressed_original":45559808,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":741016,"kb_used_data":42192,"kb_used_omap":1,"kb_used_meta":698814,"kb_avail":93630824,"statfs":{"total":96636764160,"available":95877963776,"internally_reserved":0,"allocated":43204608,"data_stored":75600045,"data_compressed":8104813,"data_compressed_allocated":11968512,"data_compressed_original":44556288,"omap_allocated":1594,"internal_metadata":715585990},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838908,"kb_used_data":63796,"kb_used_omap":1,"kb_used_meta":775102,"kb_avail":93532932,"statfs":{"total":96636764160,"available":95777722368,"internally_reserved":0,"allocated":65327104,"data_stored":115587848,"data_compressed":12603349,"data_compressed_allocated":18350080,"data_compressed_original":68808704,"omap_allocated":1593,"internal_metadata":793704903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":480720,"kb_used_data":26176,"kb_used_omap":1,"kb_used_meta":454526,"kb_avail":93891120,"statfs":{"total":96636764160,"available":96144506880,"internally_reserved":0,"allocated":26804224,"data_stored":56565779,"data_compressed":5629800,"data_compressed_allocated":8048640,"data_compressed_original":38006784,"omap_allocated":1595,"internal_metadata":465435077},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":819992,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":797374,"kb_avail":93551848,"statfs":{"total":96636764160,"available":95797092352,"internally_reserved":0,"allocated":23150592,"data_stored":52524293,"data_compressed":4801697,"data_compressed_allocated":7024640,"data_compressed_original":36601856,"omap_allocated":1595,"internal_metadata":816511429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569980,"kb_used_data":25332,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93801860,"statfs":{"total":96636764160,"available":96053104640,"internally_reserved":0,"allocated":25939968,"data_stored":50934165,"data_compressed":4989204,"data_compressed_allocated":7450624,"data_compressed_original":32641024,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21426176,"data_stored":34080905,"data_compressed":3940012,"data_compressed_allocated":5824512,"data_compressed_original":18505728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64053248,"data_stored":103270338,"data_compressed":12080873,"data_compressed_allocated":17604608,"data_compressed_original":56844288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109836,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53874688,"data_stored":86496451,"data_compressed":9867858,"data_compressed_allocated":14471168,"data_compressed_original":47112192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527526,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":970752,"data_stored":12468224,"data_compressed":586137,"data_compressed_allocated":823296,"data_compressed_original":12320768,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":18317312,"data_compressed":861685,"data_compressed_allocated":1200128,"data_compressed_original":18096128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":10649600,"data_compressed":500746,"data_compressed_allocated":696320,"data_compressed_original":10522624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1474560,"data_stored":15327232,"data_compressed":714334,"data_compressed_allocated":1089536,"data_compressed_original":14942208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":8364032,"data_compressed":393015,"data_compressed_allocated":552960,"data_compressed_original":8228864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":13688832,"data_compressed":643834,"data_compressed_allocated":892928,"data_compressed_original":13565952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":12816384,"data_compressed":602960,"data_compressed_allocated":851968,"data_compressed_original":12685312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":12402688,"data_compressed":583014,"data_compressed_allocated":811008,"data_compressed_original":12263424,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:05:31.381 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T11:05:31.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:05:31.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.565+0000 7f0f5e400640 1 Processor -- start 2024-04-25T11:05:31.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.565+0000 7f0f5e400640 1 -- start start 2024-04-25T11:05:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.565+0000 7f0f5e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 0x7f0f581550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.565+0000 7f0f5e400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 0x7f0f580c6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.565+0000 7f0f5e400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f5806d370 con 0x7f0f5815b8f0 2024-04-25T11:05:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f5e400640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0f580c7c60 con 0x7f0f580c6080 2024-04-25T11:05:31.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f5e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0f580c56e0 con 0x7f0f580c82b0 2024-04-25T11:05:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 0x7f0f580c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 0x7f0f581550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 0x7f0f580c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:57148/0 (socket says 172.21.15.16:57148) 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f4fe00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f0f5815b8f0 0x7f0f5806e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:48570/0 (socket says 172.21.15.16:48570) 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57e00640 1 -- 172.21.15.16:0/3234846142 learned_addr learned my addr 172.21.15.16:0/3234846142 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f56a00640 1 -- 172.21.15.16:0/3234846142 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892531092 0 0) 0x7f0f5806d370 con 0x7f0f5815b8f0 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f56a00640 1 -- 172.21.15.16:0/3234846142 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f3c0035c0 con 0x7f0f5815b8f0 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57400640 1 -- 172.21.15.16:0/3234846142 >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 msgr2=0x7f0f580c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57400640 1 --2- 172.21.15.16:0/3234846142 >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 0x7f0f580c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57400640 1 -- 172.21.15.16:0/3234846142 >> v1:172.21.15.186:6789/0 conn(0x7f0f5815b8f0 legacy=0x7f0f5806e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.569+0000 7f0f57400640 1 -- 172.21.15.16:0/3234846142 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5806d650 con 0x7f0f580c82b0 2024-04-25T11:05:31.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f57400640 1 --2- 172.21.15.16:0/3234846142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 0x7f0f581550c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009900 tx=0x7f0f4801ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631b8d9c3f6f70ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f56a00640 1 -- 172.21.15.16:0/3234846142 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480b5070 con 0x7f0f580c82b0 2024-04-25T11:05:31.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f56a00640 1 -- 172.21.15.16:0/3234846142 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f480a8a90 con 0x7f0f580c82b0 2024-04-25T11:05:31.575 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f56a00640 1 -- 172.21.15.16:0/3234846142 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480b0440 con 0x7f0f580c82b0 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 -- 172.21.15.16:0/3234846142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 msgr2=0x7f0f581550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 --2- 172.21.15.16:0/3234846142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 0x7f0f581550c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009900 tx=0x7f0f4801ed90 comp rx=0 tx=0).stop 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 -- 172.21.15.16:0/3234846142 shutdown_connections 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 --2- 172.21.15.16:0/3234846142 >> v2:172.21.15.186:3300/0 conn(0x7f0f580c6080 0x7f0f580c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 --2- 172.21.15.16:0/3234846142 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f580c82b0 0x7f0f581550c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 -- 172.21.15.16:0/3234846142 >> 172.21.15.16:0/3234846142 conn(0x7f0f58072950 msgr2=0x7f0f580ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 -- 172.21.15.16:0/3234846142 shutdown_connections 2024-04-25T11:05:31.576 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 -- 172.21.15.16:0/3234846142 wait complete. 2024-04-25T11:05:31.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.573+0000 7f0f5e400640 1 Processor -- start 2024-04-25T11:05:31.578 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- start start 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f580c82b0 0x7f0f58147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f5815b8f0 0x7f0f581480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0f580c69d0 con 0x7f0f580c6080 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f580c5ca0 con 0x7f0f580c82b0 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0f580c8c60 con 0x7f0f5815b8f0 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f580c82b0 0x7f0f58147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49552/0 (socket says 172.21.15.16:49552) 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 -- 172.21.15.16:0/237198688 learned_addr learned my addr 172.21.15.16:0/237198688 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57e00640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f5815b8f0 0x7f0f581480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 -- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f5815b8f0 msgr2=0x7f0f581480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f5815b8f0 0x7f0f581480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 -- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f580c82b0 msgr2=0x7f0f58147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f580c82b0 0x7f0f58147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 -- 172.21.15.16:0/237198688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f581fbf10 con 0x7f0f580c6080 2024-04-25T11:05:31.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f57400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f4801d440 tx=0x7f0f4801bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480b5040 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f480c0070 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48003620 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f581fc1f0 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.577+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f580c4ff0 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f58050750 con 0x7f0f580c6080 2024-04-25T11:05:31.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0f48003800 con 0x7f0f580c6080 2024-04-25T11:05:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f4f400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 0x7f0f30071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0f4812d1d0 con 0x7f0f580c6080 2024-04-25T11:05:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f4fe00640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 0x7f0f30071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.581+0000 7f0f4fe00640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 0x7f0f30071ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007fd0 tx=0x7f0f40007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.585+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f480188f0 con 0x7f0f580c6080 2024-04-25T11:05:31.750 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.745+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f58153f60 con 0x7f0f3006f5a0 2024-04-25T11:05:31.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.769+0000 7f0f4f400640 1 -- 172.21.15.16:0/237198688 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336376 (secure 0 0 0) 0x7f0f58153f60 con 0x7f0f3006f5a0 2024-04-25T11:05:31.777 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:31.779 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:05:31.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 msgr2=0x7f0f30071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 0x7f0f30071ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007fd0 tx=0x7f0f40007ce0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 msgr2=0x7f0f5815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.780 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f4801d440 tx=0x7f0f4801bb30 comp rx=0 tx=0).stop 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 shutdown_connections 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0f3006f5a0 0x7f0f30071ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f5815b8f0 0x7f0f581480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f580c82b0 0x7f0f58147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 --2- 172.21.15.16:0/237198688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f580c6080 0x7f0f5815cdc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 >> 172.21.15.16:0/237198688 conn(0x7f0f58072950 msgr2=0x7f0f580cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 shutdown_connections 2024-04-25T11:05:31.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.773+0000 7f0f5e400640 1 -- 172.21.15.16:0/237198688 wait complete. 2024-04-25T11:05:31.799 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":824,"stamp":"2024-04-25T11:05:30.355126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":292132854,"num_objects":453,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":453,"num_whiteouts":0,"num_read":7927,"num_read_kb":1313316,"num_write":298873,"num_write_kb":5285850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":476550,"ondisk_log_size":476550,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5765044,"kb_used_data":307692,"kb_used_omap":12,"kb_used_meta":5457267,"kb_avail":749209676,"statfs":{"total":773094113280,"available":767190708224,"internally_reserved":0,"allocated":315076608,"data_stored":590831368,"data_compressed":60630618,"data_compressed_allocated":89006080,"data_compressed_original":366338048,"omap_allocated":12751,"internal_metadata":5588241969},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,3,3,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-194504316,"num_objects":-1545,"num_object_clones":0,"num_object_copies":-5210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1545,"num_whiteouts":0,"num_read":25,"num_read_kb":3165,"num_write":2992,"num_write_kb":35827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004634"},"pg_stats":[{"pgid":"2.1f","version":"28'1879","reported_seq":1918,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:01:56.663229+0000","last_change":"2024-04-25T10:38:58.375663+0000","last_active":"2024-04-25T11:01:56.663229+0000","last_peered":"2024-04-25T11:01:56.663229+0000","last_clean":"2024-04-25T11:01:56.663229+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:01:56.663229+0000","last_undegraded":"2024-04-25T11:01:56.663229+0000","last_fullsized":"2024-04-25T11:01:56.663229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1893,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1893","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857863+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T11:05:29.857863+0000","last_peered":"2024-04-25T11:05:29.857863+0000","last_clean":"2024-04-25T11:05:29.857863+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:29.857863+0000","last_undegraded":"2024-04-25T11:05:29.857863+0000","last_fullsized":"2024-04-25T11:05:29.857863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6388","reported_seq":6461,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.602400+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T11:05:29.602400+0000","last_peered":"2024-04-25T11:05:29.602400+0000","last_clean":"2024-04-25T11:05:29.602400+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:29.602400+0000","last_undegraded":"2024-04-25T11:05:29.602400+0000","last_fullsized":"2024-04-25T11:05:29.602400+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23133,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4423,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4891","reported_seq":4931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.612083+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T11:05:27.612083+0000","last_peered":"2024-04-25T11:05:27.612083+0000","last_clean":"2024-04-25T11:05:27.612083+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:27.612083+0000","last_undegraded":"2024-04-25T11:05:27.612083+0000","last_fullsized":"2024-04-25T11:05:27.612083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1892","reported_seq":1929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.554231+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T11:05:24.554231+0000","last_peered":"2024-04-25T11:05:24.554231+0000","last_clean":"2024-04-25T11:05:24.554231+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:24.554231+0000","last_undegraded":"2024-04-25T11:05:24.554231+0000","last_fullsized":"2024-04-25T11:05:24.554231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6747","reported_seq":6875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.976907+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T11:05:24.976907+0000","last_peered":"2024-04-25T11:05:24.976907+0000","last_clean":"2024-04-25T11:05:24.976907+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:24.976907+0000","last_undegraded":"2024-04-25T11:05:24.976907+0000","last_fullsized":"2024-04-25T11:05:24.976907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6747,"log_dups_size":0,"ondisk_log_size":6747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1640448,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4751,"num_write_kb":130705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7161","reported_seq":7198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:12.813758+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T11:05:12.813758+0000","last_peered":"2024-04-25T11:05:12.813758+0000","last_clean":"2024-04-25T11:05:12.813758+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:12.813758+0000","last_undegraded":"2024-04-25T11:05:12.813758+0000","last_fullsized":"2024-04-25T11:05:12.813758+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7162,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1932","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635183+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T11:05:24.635183+0000","last_peered":"2024-04-25T11:05:24.635183+0000","last_clean":"2024-04-25T11:05:24.635183+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:24.635183+0000","last_undegraded":"2024-04-25T11:05:24.635183+0000","last_fullsized":"2024-04-25T11:05:24.635183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6457","reported_seq":6673,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.734570+0000","last_change":"2024-04-25T10:39:39.057558+0000","last_active":"2024-04-25T11:05:24.734570+0000","last_peered":"2024-04-25T11:05:24.734570+0000","last_clean":"2024-04-25T11:05:24.734570+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:24.734570+0000","last_undegraded":"2024-04-25T11:05:24.734570+0000","last_fullsized":"2024-04-25T11:05:24.734570+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6457,"log_dups_size":0,"ondisk_log_size":6457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4420,"num_write_kb":116213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3801","reported_seq":3838,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.537738+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T11:05:08.537738+0000","last_peered":"2024-04-25T11:05:08.537738+0000","last_clean":"2024-04-25T11:05:08.537738+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:08.537738+0000","last_undegraded":"2024-04-25T11:05:08.537738+0000","last_fullsized":"2024-04-25T11:05:08.537738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3801,"log_dups_size":0,"ondisk_log_size":3801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3804,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1878","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.030107+0000","last_change":"2024-04-25T10:39:38.922901+0000","last_active":"2024-04-25T11:05:24.030107+0000","last_peered":"2024-04-25T11:05:24.030107+0000","last_clean":"2024-04-25T11:05:24.030107+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:24.030107+0000","last_undegraded":"2024-04-25T11:05:24.030107+0000","last_fullsized":"2024-04-25T11:05:24.030107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6614","reported_seq":6735,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.655131+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T11:05:24.655131+0000","last_peered":"2024-04-25T11:05:24.655131+0000","last_clean":"2024-04-25T11:05:24.655131+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:24.655131+0000","last_undegraded":"2024-04-25T11:05:24.655131+0000","last_fullsized":"2024-04-25T11:05:24.655131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6614,"log_dups_size":0,"ondisk_log_size":6614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":937291,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4650,"num_write_kb":122056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1909","reported_seq":1946,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.856637+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T11:05:24.856637+0000","last_peered":"2024-04-25T11:05:24.856637+0000","last_clean":"2024-04-25T11:05:24.856637+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:24.856637+0000","last_undegraded":"2024-04-25T11:05:24.856637+0000","last_fullsized":"2024-04-25T11:05:24.856637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5501","reported_seq":5539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:45.406535+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T11:03:45.406535+0000","last_peered":"2024-04-25T11:03:45.406535+0000","last_clean":"2024-04-25T11:03:45.406535+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:03:45.406535+0000","last_undegraded":"2024-04-25T11:03:45.406535+0000","last_fullsized":"2024-04-25T11:03:45.406535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5501,"log_dups_size":0,"ondisk_log_size":5501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5518,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6767","reported_seq":6845,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.942115+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T11:05:24.942115+0000","last_peered":"2024-04-25T11:05:24.942115+0000","last_clean":"2024-04-25T11:05:24.942115+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:24.942115+0000","last_undegraded":"2024-04-25T11:05:24.942115+0000","last_fullsized":"2024-04-25T11:05:24.942115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6767,"log_dups_size":0,"ondisk_log_size":6767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83190,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4710,"num_write_kb":126882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1919","reported_seq":1955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857498+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T11:05:29.857498+0000","last_peered":"2024-04-25T11:05:29.857498+0000","last_clean":"2024-04-25T11:05:29.857498+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:29.857498+0000","last_undegraded":"2024-04-25T11:05:29.857498+0000","last_fullsized":"2024-04-25T11:05:29.857498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4960","reported_seq":5000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:13.419386+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T11:04:13.419386+0000","last_peered":"2024-04-25T11:04:13.419386+0000","last_clean":"2024-04-25T11:04:13.419386+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:04:13.419386+0000","last_undegraded":"2024-04-25T11:04:13.419386+0000","last_fullsized":"2024-04-25T11:04:13.419386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4960,"log_dups_size":0,"ondisk_log_size":4960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4959,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7052","reported_seq":7152,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914288+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T11:05:24.914288+0000","last_peered":"2024-04-25T11:05:24.914288+0000","last_clean":"2024-04-25T11:05:24.914288+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:24.914288+0000","last_undegraded":"2024-04-25T11:05:24.914288+0000","last_fullsized":"2024-04-25T11:05:24.914288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7052,"log_dups_size":0,"ondisk_log_size":7052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308672,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5087,"num_write_kb":139955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1950","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.851278+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T11:05:29.851278+0000","last_peered":"2024-04-25T11:05:29.851278+0000","last_clean":"2024-04-25T11:05:29.851278+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:29.851278+0000","last_undegraded":"2024-04-25T11:05:29.851278+0000","last_fullsized":"2024-04-25T11:05:29.851278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1950,"log_dups_size":0,"ondisk_log_size":1950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2275","reported_seq":2315,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:54.070815+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T11:03:54.070815+0000","last_peered":"2024-04-25T11:03:54.070815+0000","last_clean":"2024-04-25T11:03:54.070815+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:03:54.070815+0000","last_undegraded":"2024-04-25T11:03:54.070815+0000","last_fullsized":"2024-04-25T11:03:54.070815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2275,"log_dups_size":0,"ondisk_log_size":2275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2283,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6667","reported_seq":6810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.721941+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T11:05:24.721941+0000","last_peered":"2024-04-25T11:05:24.721941+0000","last_clean":"2024-04-25T11:05:24.721941+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:24.721941+0000","last_undegraded":"2024-04-25T11:05:24.721941+0000","last_fullsized":"2024-04-25T11:05:24.721941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6667,"log_dups_size":0,"ondisk_log_size":6667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4759,"num_write_kb":122782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1930","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.439676+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T11:05:24.439676+0000","last_peered":"2024-04-25T11:05:24.439676+0000","last_clean":"2024-04-25T11:05:24.439676+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:24.439676+0000","last_undegraded":"2024-04-25T11:05:24.439676+0000","last_fullsized":"2024-04-25T11:05:24.439676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1616","reported_seq":1655,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:54.280349+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T11:04:54.280349+0000","last_peered":"2024-04-25T11:04:54.280349+0000","last_clean":"2024-04-25T11:04:54.280349+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:04:54.280349+0000","last_undegraded":"2024-04-25T11:04:54.280349+0000","last_fullsized":"2024-04-25T11:04:54.280349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1627,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7407","reported_seq":7508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.824089+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T11:05:24.824089+0000","last_peered":"2024-04-25T11:05:24.824089+0000","last_clean":"2024-04-25T11:05:24.824089+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:24.824089+0000","last_undegraded":"2024-04-25T11:05:24.824089+0000","last_fullsized":"2024-04-25T11:05:24.824089+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7207,"log_dups_size":0,"ondisk_log_size":7207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":520192,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5357,"num_write_kb":119171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.698283+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T11:05:24.698283+0000","last_peered":"2024-04-25T11:05:24.698283+0000","last_clean":"2024-04-25T11:05:24.698283+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:24.698283+0000","last_undegraded":"2024-04-25T11:05:24.698283+0000","last_fullsized":"2024-04-25T11:05:24.698283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2472","reported_seq":2511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.217363+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T11:04:08.217363+0000","last_peered":"2024-04-25T11:04:08.217363+0000","last_clean":"2024-04-25T11:04:08.217363+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:04:08.217363+0000","last_undegraded":"2024-04-25T11:04:08.217363+0000","last_fullsized":"2024-04-25T11:04:08.217363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2472,"log_dups_size":0,"ondisk_log_size":2472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2498,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6585","reported_seq":6690,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.773668+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T11:05:24.773668+0000","last_peered":"2024-04-25T11:05:24.773668+0000","last_clean":"2024-04-25T11:05:24.773668+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:24.773668+0000","last_undegraded":"2024-04-25T11:05:24.773668+0000","last_fullsized":"2024-04-25T11:05:24.773668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6585,"log_dups_size":0,"ondisk_log_size":6585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4614,"num_write_kb":126370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1849","reported_seq":1886,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.868941+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T11:05:29.868941+0000","last_peered":"2024-04-25T11:05:29.868941+0000","last_clean":"2024-04-25T11:05:29.868941+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:29.868941+0000","last_undegraded":"2024-04-25T11:05:29.868941+0000","last_fullsized":"2024-04-25T11:05:29.868941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4061","reported_seq":4168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.208428+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T11:05:27.208428+0000","last_peered":"2024-04-25T11:05:27.208428+0000","last_clean":"2024-04-25T11:05:27.208428+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:27.208428+0000","last_undegraded":"2024-04-25T11:05:27.208428+0000","last_fullsized":"2024-04-25T11:05:27.208428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4061,"log_dups_size":0,"ondisk_log_size":4061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525529,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":556,"num_write":6791,"num_write_kb":36780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6491","reported_seq":6700,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617295+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T11:05:29.617295+0000","last_peered":"2024-04-25T11:05:29.617295+0000","last_clean":"2024-04-25T11:05:29.617295+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:29.617295+0000","last_undegraded":"2024-04-25T11:05:29.617295+0000","last_fullsized":"2024-04-25T11:05:29.617295+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6291,"log_dups_size":0,"ondisk_log_size":6291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":751125,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4480,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1912","reported_seq":1950,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.004886+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T11:05:24.004886+0000","last_peered":"2024-04-25T11:05:24.004886+0000","last_clean":"2024-04-25T11:05:24.004886+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:24.004886+0000","last_undegraded":"2024-04-25T11:05:24.004886+0000","last_fullsized":"2024-04-25T11:05:24.004886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4555","reported_seq":4594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.162006+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T11:04:08.162006+0000","last_peered":"2024-04-25T11:04:08.162006+0000","last_clean":"2024-04-25T11:04:08.162006+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:04:08.162006+0000","last_undegraded":"2024-04-25T11:04:08.162006+0000","last_fullsized":"2024-04-25T11:04:08.162006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4555,"log_dups_size":0,"ondisk_log_size":4555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4566,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7267","reported_seq":7517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.955878+0000","last_change":"2024-04-25T10:39:39.090203+0000","last_active":"2024-04-25T11:05:24.955878+0000","last_peered":"2024-04-25T11:05:24.955878+0000","last_clean":"2024-04-25T11:05:24.955878+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:24.955878+0000","last_undegraded":"2024-04-25T11:05:24.955878+0000","last_fullsized":"2024-04-25T11:05:24.955878+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7267,"log_dups_size":0,"ondisk_log_size":7267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3488000,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5258,"num_write_kb":158271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1885","reported_seq":1923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.783599+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T11:05:24.783599+0000","last_peered":"2024-04-25T11:05:24.783599+0000","last_clean":"2024-04-25T11:05:24.783599+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:24.783599+0000","last_undegraded":"2024-04-25T11:05:24.783599+0000","last_fullsized":"2024-04-25T11:05:24.783599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4320","reported_seq":4360,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:03.302219+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T11:05:03.302219+0000","last_peered":"2024-04-25T11:05:03.302219+0000","last_clean":"2024-04-25T11:05:03.302219+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:03.302219+0000","last_undegraded":"2024-04-25T11:05:03.302219+0000","last_fullsized":"2024-04-25T11:05:03.302219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4320,"log_dups_size":0,"ondisk_log_size":4320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4326,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7443","reported_seq":7736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.621494+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T11:05:24.621494+0000","last_peered":"2024-04-25T11:05:24.621494+0000","last_clean":"2024-04-25T11:05:24.621494+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:24.621494+0000","last_undegraded":"2024-04-25T11:05:24.621494+0000","last_fullsized":"2024-04-25T11:05:24.621494+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7343,"log_dups_size":0,"ondisk_log_size":7343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4627106,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5425,"num_write_kb":156322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1901","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.961767+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T11:05:24.961767+0000","last_peered":"2024-04-25T11:05:24.961767+0000","last_clean":"2024-04-25T11:05:24.961767+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:24.961767+0000","last_undegraded":"2024-04-25T11:05:24.961767+0000","last_fullsized":"2024-04-25T11:05:24.961767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5566","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:07.927173+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T11:03:07.927173+0000","last_peered":"2024-04-25T11:03:07.927173+0000","last_clean":"2024-04-25T11:03:07.927173+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:03:07.927173+0000","last_undegraded":"2024-04-25T11:03:07.927173+0000","last_fullsized":"2024-04-25T11:03:07.927173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5566,"log_dups_size":0,"ondisk_log_size":5566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5571,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6953","reported_seq":7026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.838139+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T11:05:24.838139+0000","last_peered":"2024-04-25T11:05:24.838139+0000","last_clean":"2024-04-25T11:05:24.838139+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:24.838139+0000","last_undegraded":"2024-04-25T11:05:24.838139+0000","last_fullsized":"2024-04-25T11:05:24.838139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6953,"log_dups_size":0,"ondisk_log_size":6953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3785024,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4969,"num_write_kb":146106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1903","reported_seq":1942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.409006+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T11:05:24.409006+0000","last_peered":"2024-04-25T11:05:24.409006+0000","last_clean":"2024-04-25T11:05:24.409006+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:24.409006+0000","last_undegraded":"2024-04-25T11:05:24.409006+0000","last_fullsized":"2024-04-25T11:05:24.409006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6022","reported_seq":7458,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:10.103236+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T11:04:10.103236+0000","last_peered":"2024-04-25T11:04:10.103236+0000","last_clean":"2024-04-25T11:04:10.103236+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:04:10.103236+0000","last_undegraded":"2024-04-25T11:04:10.103236+0000","last_fullsized":"2024-04-25T11:04:10.103236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6022,"log_dups_size":0,"ondisk_log_size":6022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6036,"num_write_kb":43945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6540","reported_seq":7081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.886058+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T11:05:24.886058+0000","last_peered":"2024-04-25T11:05:24.886058+0000","last_clean":"2024-04-25T11:05:24.886058+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:24.886058+0000","last_undegraded":"2024-04-25T11:05:24.886058+0000","last_fullsized":"2024-04-25T11:05:24.886058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6540,"log_dups_size":0,"ondisk_log_size":6540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347382,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4571,"num_write_kb":125130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.676299+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T11:05:24.676299+0000","last_peered":"2024-04-25T11:05:24.676299+0000","last_clean":"2024-04-25T11:05:24.676299+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:24.676299+0000","last_undegraded":"2024-04-25T11:05:24.676299+0000","last_fullsized":"2024-04-25T11:05:24.676299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:31.579703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5526","reported_seq":5566,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:04.930461+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T11:05:04.930461+0000","last_peered":"2024-04-25T11:05:04.930461+0000","last_clean":"2024-04-25T11:05:04.930461+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:04.930461+0000","last_undegraded":"2024-04-25T11:05:04.930461+0000","last_fullsized":"2024-04-25T11:05:04.930461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5526,"log_dups_size":0,"ondisk_log_size":5526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5535,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6619","reported_seq":6739,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.914010+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T11:05:24.914010+0000","last_peered":"2024-04-25T11:05:24.914010+0000","last_clean":"2024-04-25T11:05:24.914010+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:24.914010+0000","last_undegraded":"2024-04-25T11:05:24.914010+0000","last_fullsized":"2024-04-25T11:05:24.914010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6619,"log_dups_size":0,"ondisk_log_size":6619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1997569,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4568,"num_write_kb":119677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1940","reported_seq":1977,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.863204+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T11:05:29.863204+0000","last_peered":"2024-04-25T11:05:29.863204+0000","last_clean":"2024-04-25T11:05:29.863204+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:29.863204+0000","last_undegraded":"2024-04-25T11:05:29.863204+0000","last_fullsized":"2024-04-25T11:05:29.863204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1940,"log_dups_size":0,"ondisk_log_size":1940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3766","reported_seq":3806,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:01.058872+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T11:04:01.058872+0000","last_peered":"2024-04-25T11:04:01.058872+0000","last_clean":"2024-04-25T11:04:01.058872+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:04:01.058872+0000","last_undegraded":"2024-04-25T11:04:01.058872+0000","last_fullsized":"2024-04-25T11:04:01.058872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3766,"log_dups_size":0,"ondisk_log_size":3766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3779,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:55.392906+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T11:02:55.392906+0000","last_peered":"2024-04-25T11:02:55.392906+0000","last_clean":"2024-04-25T11:02:55.392906+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:02:55.392906+0000","last_undegraded":"2024-04-25T11:02:55.392906+0000","last_fullsized":"2024-04-25T11:02:55.392906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6731","reported_seq":6866,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.935024+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T11:05:24.935024+0000","last_peered":"2024-04-25T11:05:24.935024+0000","last_clean":"2024-04-25T11:05:24.935024+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:24.935024+0000","last_undegraded":"2024-04-25T11:05:24.935024+0000","last_fullsized":"2024-04-25T11:05:24.935024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6731,"log_dups_size":0,"ondisk_log_size":6731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1947904,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4783,"num_write_kb":129912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1903","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.784084+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T11:05:24.784084+0000","last_peered":"2024-04-25T11:05:24.784084+0000","last_clean":"2024-04-25T11:05:24.784084+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:24.784084+0000","last_undegraded":"2024-04-25T11:05:24.784084+0000","last_fullsized":"2024-04-25T11:05:24.784084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4301","reported_seq":4340,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:17.258158+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T11:04:17.258158+0000","last_peered":"2024-04-25T11:04:17.258158+0000","last_clean":"2024-04-25T11:04:17.258158+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:04:17.258158+0000","last_undegraded":"2024-04-25T11:04:17.258158+0000","last_fullsized":"2024-04-25T11:04:17.258158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4301,"log_dups_size":0,"ondisk_log_size":4301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4301,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6640","reported_seq":6864,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.863696+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T11:05:24.863696+0000","last_peered":"2024-04-25T11:05:24.863696+0000","last_clean":"2024-04-25T11:05:24.863696+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:24.863696+0000","last_undegraded":"2024-04-25T11:05:24.863696+0000","last_fullsized":"2024-04-25T11:05:24.863696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6640,"log_dups_size":0,"ondisk_log_size":6640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2199360,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4599,"num_write_kb":120343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1891","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.901993+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T11:05:24.901993+0000","last_peered":"2024-04-25T11:05:24.901993+0000","last_clean":"2024-04-25T11:05:24.901993+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:24.901993+0000","last_undegraded":"2024-04-25T11:05:24.901993+0000","last_fullsized":"2024-04-25T11:05:24.901993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5439","reported_seq":5478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:22.004363+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T11:03:22.004363+0000","last_peered":"2024-04-25T11:03:22.004363+0000","last_clean":"2024-04-25T11:03:22.004363+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:03:22.004363+0000","last_undegraded":"2024-04-25T11:03:22.004363+0000","last_fullsized":"2024-04-25T11:03:22.004363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5439,"log_dups_size":0,"ondisk_log_size":5439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5440,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6660","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.845436+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T11:05:24.845436+0000","last_peered":"2024-04-25T11:05:24.845436+0000","last_clean":"2024-04-25T11:05:24.845436+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:24.845436+0000","last_undegraded":"2024-04-25T11:05:24.845436+0000","last_fullsized":"2024-04-25T11:05:24.845436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6660,"log_dups_size":0,"ondisk_log_size":6660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3704832,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4609,"num_write_kb":135068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1826","reported_seq":1847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.700110+0000","last_change":"2024-04-25T10:39:38.923770+0000","last_active":"2024-04-25T11:05:24.700110+0000","last_peered":"2024-04-25T11:05:24.700110+0000","last_clean":"2024-04-25T11:05:24.700110+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:24.700110+0000","last_undegraded":"2024-04-25T11:05:24.700110+0000","last_fullsized":"2024-04-25T11:05:24.700110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:27.499233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4831","reported_seq":4870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:21.224189+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T11:05:21.224189+0000","last_peered":"2024-04-25T11:05:21.224189+0000","last_clean":"2024-04-25T11:05:21.224189+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:21.224189+0000","last_undegraded":"2024-04-25T11:05:21.224189+0000","last_fullsized":"2024-04-25T11:05:21.224189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4831,"log_dups_size":0,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4836,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7074","reported_seq":7141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.997288+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T11:05:24.997288+0000","last_peered":"2024-04-25T11:05:24.997288+0000","last_clean":"2024-04-25T11:05:24.997288+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:24.997288+0000","last_undegraded":"2024-04-25T11:05:24.997288+0000","last_fullsized":"2024-04-25T11:05:24.997288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7074,"log_dups_size":0,"ondisk_log_size":7074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5043,"num_write_kb":119741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1915","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.501936+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T11:05:24.501936+0000","last_peered":"2024-04-25T11:05:24.501936+0000","last_clean":"2024-04-25T11:05:24.501936+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:24.501936+0000","last_undegraded":"2024-04-25T11:05:24.501936+0000","last_fullsized":"2024-04-25T11:05:24.501936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3721","reported_seq":3760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:08.536781+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T11:05:08.536781+0000","last_peered":"2024-04-25T11:05:08.536781+0000","last_clean":"2024-04-25T11:05:08.536781+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:08.536781+0000","last_undegraded":"2024-04-25T11:05:08.536781+0000","last_fullsized":"2024-04-25T11:05:08.536781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3721,"log_dups_size":0,"ondisk_log_size":3721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3718,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6586","reported_seq":6710,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.848846+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T11:05:24.848846+0000","last_peered":"2024-04-25T11:05:24.848846+0000","last_clean":"2024-04-25T11:05:24.848846+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:24.848846+0000","last_undegraded":"2024-04-25T11:05:24.848846+0000","last_fullsized":"2024-04-25T11:05:24.848846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6586,"log_dups_size":0,"ondisk_log_size":6586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153332,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4494,"num_write_kb":119096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1931","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.870826+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T11:05:24.870826+0000","last_peered":"2024-04-25T11:05:24.870826+0000","last_clean":"2024-04-25T11:05:24.870826+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:24.870826+0000","last_undegraded":"2024-04-25T11:05:24.870826+0000","last_fullsized":"2024-04-25T11:05:24.870826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2218","reported_seq":2257,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:41.881885+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T11:02:41.881885+0000","last_peered":"2024-04-25T11:02:41.881885+0000","last_clean":"2024-04-25T11:02:41.881885+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:02:41.881885+0000","last_undegraded":"2024-04-25T11:02:41.881885+0000","last_fullsized":"2024-04-25T11:02:41.881885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2233,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6549","reported_seq":6799,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.441422+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T11:05:24.441422+0000","last_peered":"2024-04-25T11:05:24.441422+0000","last_clean":"2024-04-25T11:05:24.441422+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:24.441422+0000","last_undegraded":"2024-04-25T11:05:24.441422+0000","last_fullsized":"2024-04-25T11:05:24.441422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1778338,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4507,"num_write_kb":126341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1845","reported_seq":1881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.008456+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T11:05:25.008456+0000","last_peered":"2024-04-25T11:05:25.008456+0000","last_clean":"2024-04-25T11:05:25.008456+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:25.008456+0000","last_undegraded":"2024-04-25T11:05:25.008456+0000","last_fullsized":"2024-04-25T11:05:25.008456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1709","reported_seq":1747,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:37.187411+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T11:04:37.187411+0000","last_peered":"2024-04-25T11:04:37.187411+0000","last_clean":"2024-04-25T11:04:37.187411+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:04:37.187411+0000","last_undegraded":"2024-04-25T11:04:37.187411+0000","last_fullsized":"2024-04-25T11:04:37.187411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1709,"log_dups_size":0,"ondisk_log_size":1709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195150,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1713,"num_write_kb":21293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6811","reported_seq":6902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.475137+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T11:05:29.475137+0000","last_peered":"2024-04-25T11:05:29.475137+0000","last_clean":"2024-04-25T11:05:29.475137+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:29.475137+0000","last_undegraded":"2024-04-25T11:05:29.475137+0000","last_fullsized":"2024-04-25T11:05:29.475137+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2794578,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4806,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1895","reported_seq":1931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.229038+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T11:05:24.229038+0000","last_peered":"2024-04-25T11:05:24.229038+0000","last_clean":"2024-04-25T11:05:24.229038+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:24.229038+0000","last_undegraded":"2024-04-25T11:05:24.229038+0000","last_fullsized":"2024-04-25T11:05:24.229038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1895,"log_dups_size":0,"ondisk_log_size":1895,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1354","reported_seq":1393,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:42.358941+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T11:04:42.358941+0000","last_peered":"2024-04-25T11:04:42.358941+0000","last_clean":"2024-04-25T11:04:42.358941+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:04:42.358941+0000","last_undegraded":"2024-04-25T11:04:42.358941+0000","last_fullsized":"2024-04-25T11:04:42.358941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1354,"log_dups_size":0,"ondisk_log_size":1354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1360,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6430","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.528634+0000","last_change":"2024-04-25T10:39:39.093855+0000","last_active":"2024-04-25T11:05:29.528634+0000","last_peered":"2024-04-25T11:05:29.528634+0000","last_clean":"2024-04-25T11:05:29.528634+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:29.528634+0000","last_undegraded":"2024-04-25T11:05:29.528634+0000","last_fullsized":"2024-04-25T11:05:29.528634+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.407701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2247300,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4459,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1918","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.889620+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T11:05:24.889620+0000","last_peered":"2024-04-25T11:05:24.889620+0000","last_clean":"2024-04-25T11:05:24.889620+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:24.889620+0000","last_undegraded":"2024-04-25T11:05:24.889620+0000","last_fullsized":"2024-04-25T11:05:24.889620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1918,"log_dups_size":0,"ondisk_log_size":1918,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:44.032785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3868","reported_seq":3906,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:23.139020+0000","last_change":"2024-04-25T10:38:58.351039+0000","last_active":"2024-04-25T11:04:23.139020+0000","last_peered":"2024-04-25T11:04:23.139020+0000","last_clean":"2024-04-25T11:04:23.139020+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:04:23.139020+0000","last_undegraded":"2024-04-25T11:04:23.139020+0000","last_fullsized":"2024-04-25T11:04:23.139020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3868,"log_dups_size":0,"ondisk_log_size":3868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3879,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6414","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.694597+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T11:05:24.694597+0000","last_peered":"2024-04-25T11:05:24.694597+0000","last_clean":"2024-04-25T11:05:24.694597+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:24.694597+0000","last_undegraded":"2024-04-25T11:05:24.694597+0000","last_fullsized":"2024-04-25T11:05:24.694597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6414,"log_dups_size":0,"ondisk_log_size":6414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2392064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4464,"num_write_kb":118058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1845","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.635070+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T11:05:24.635070+0000","last_peered":"2024-04-25T11:05:24.635070+0000","last_clean":"2024-04-25T11:05:24.635070+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:24.635070+0000","last_undegraded":"2024-04-25T11:05:24.635070+0000","last_fullsized":"2024-04-25T11:05:24.635070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1845,"log_dups_size":0,"ondisk_log_size":1845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7352","reported_seq":8015,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:25.342654+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T11:05:25.342654+0000","last_peered":"2024-04-25T11:05:25.342654+0000","last_clean":"2024-04-25T11:05:25.342654+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:25.342654+0000","last_undegraded":"2024-04-25T11:05:25.342654+0000","last_fullsized":"2024-04-25T11:05:25.342654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7352,"log_dups_size":0,"ondisk_log_size":7352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18861223,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7361,"num_write_kb":54825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6556","reported_seq":6620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.893573+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T11:05:24.893573+0000","last_peered":"2024-04-25T11:05:24.893573+0000","last_clean":"2024-04-25T11:05:24.893573+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:24.893573+0000","last_undegraded":"2024-04-25T11:05:24.893573+0000","last_fullsized":"2024-04-25T11:05:24.893573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6556,"log_dups_size":0,"ondisk_log_size":6556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457462,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4565,"num_write_kb":116078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1882","reported_seq":1919,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.941108+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T11:05:24.941108+0000","last_peered":"2024-04-25T11:05:24.941108+0000","last_clean":"2024-04-25T11:05:24.941108+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:24.941108+0000","last_undegraded":"2024-04-25T11:05:24.941108+0000","last_fullsized":"2024-04-25T11:05:24.941108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5160","reported_seq":5198,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.043331+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T11:05:23.043331+0000","last_peered":"2024-04-25T11:05:23.043331+0000","last_clean":"2024-04-25T11:05:23.043331+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:23.043331+0000","last_undegraded":"2024-04-25T11:05:23.043331+0000","last_fullsized":"2024-04-25T11:05:23.043331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5160,"log_dups_size":0,"ondisk_log_size":5160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5167,"num_write_kb":31677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6454","reported_seq":6511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.683667+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T11:05:24.683667+0000","last_peered":"2024-04-25T11:05:24.683667+0000","last_clean":"2024-04-25T11:05:24.683667+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:24.683667+0000","last_undegraded":"2024-04-25T11:05:24.683667+0000","last_fullsized":"2024-04-25T11:05:24.683667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152907,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4389,"num_write_kb":121841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1909","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.740602+0000","last_change":"2024-04-25T10:38:59.355552+0000","last_active":"2024-04-25T11:05:24.740602+0000","last_peered":"2024-04-25T11:05:24.740602+0000","last_clean":"2024-04-25T11:05:24.740602+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:24.740602+0000","last_undegraded":"2024-04-25T11:05:24.740602+0000","last_fullsized":"2024-04-25T11:05:24.740602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5283","reported_seq":5321,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:08.192326+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T11:04:08.192326+0000","last_peered":"2024-04-25T11:04:08.192326+0000","last_clean":"2024-04-25T11:04:08.192326+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:04:08.192326+0000","last_undegraded":"2024-04-25T11:04:08.192326+0000","last_fullsized":"2024-04-25T11:04:08.192326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5283,"log_dups_size":0,"ondisk_log_size":5283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5288,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6496","reported_seq":6832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.606606+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T11:05:29.606606+0000","last_peered":"2024-04-25T11:05:29.606606+0000","last_clean":"2024-04-25T11:05:29.606606+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:29.606606+0000","last_undegraded":"2024-04-25T11:05:29.606606+0000","last_fullsized":"2024-04-25T11:05:29.606606+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6296,"log_dups_size":0,"ondisk_log_size":6296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1406930,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4578,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1869","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.582270+0000","last_change":"2024-04-25T10:39:38.920344+0000","last_active":"2024-04-25T11:05:23.582270+0000","last_peered":"2024-04-25T11:05:23.582270+0000","last_clean":"2024-04-25T11:05:23.582270+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:23.582270+0000","last_undegraded":"2024-04-25T11:05:23.582270+0000","last_fullsized":"2024-04-25T11:05:23.582270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1869,"log_dups_size":0,"ondisk_log_size":1869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4609","reported_seq":5259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:00.879470+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T11:05:00.879470+0000","last_peered":"2024-04-25T11:05:00.879470+0000","last_clean":"2024-04-25T11:05:00.879470+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:00.879470+0000","last_undegraded":"2024-04-25T11:05:00.879470+0000","last_fullsized":"2024-04-25T11:05:00.879470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4609,"log_dups_size":0,"ondisk_log_size":4609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4607,"num_write_kb":39069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6794","reported_seq":7231,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.617793+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T11:05:29.617793+0000","last_peered":"2024-04-25T11:05:29.617793+0000","last_clean":"2024-04-25T11:05:29.617793+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:29.617793+0000","last_undegraded":"2024-04-25T11:05:29.617793+0000","last_fullsized":"2024-04-25T11:05:29.617793+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6293,"log_dups_size":0,"ondisk_log_size":6293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094726,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4765,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6711","reported_seq":6847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862188+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T11:05:24.862188+0000","last_peered":"2024-04-25T11:05:24.862188+0000","last_clean":"2024-04-25T11:05:24.862188+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:24.862188+0000","last_undegraded":"2024-04-25T11:05:24.862188+0000","last_fullsized":"2024-04-25T11:05:24.862188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6711,"log_dups_size":0,"ondisk_log_size":6711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":581376,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4776,"num_write_kb":127958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1838","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.539513+0000","last_change":"2024-04-25T10:38:59.325581+0000","last_active":"2024-04-25T11:05:24.539513+0000","last_peered":"2024-04-25T11:05:24.539513+0000","last_clean":"2024-04-25T11:05:24.539513+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:24.539513+0000","last_undegraded":"2024-04-25T11:05:24.539513+0000","last_fullsized":"2024-04-25T11:05:24.539513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7631","reported_seq":7669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:17.560722+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T11:05:17.560722+0000","last_peered":"2024-04-25T11:05:17.560722+0000","last_clean":"2024-04-25T11:05:17.560722+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:17.560722+0000","last_undegraded":"2024-04-25T11:05:17.560722+0000","last_fullsized":"2024-04-25T11:05:17.560722+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6425","reported_seq":6755,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.702013+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T11:05:24.702013+0000","last_peered":"2024-04-25T11:05:24.702013+0000","last_clean":"2024-04-25T11:05:24.702013+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:24.702013+0000","last_undegraded":"2024-04-25T11:05:24.702013+0000","last_fullsized":"2024-04-25T11:05:24.702013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6425,"log_dups_size":0,"ondisk_log_size":6425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4450,"num_write_kb":134560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1937","reported_seq":1972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.850546+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T11:05:29.850546+0000","last_peered":"2024-04-25T11:05:29.850546+0000","last_clean":"2024-04-25T11:05:29.850546+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:29.850546+0000","last_undegraded":"2024-04-25T11:05:29.850546+0000","last_fullsized":"2024-04-25T11:05:29.850546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3989","reported_seq":4026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:52.467207+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T11:03:52.467207+0000","last_peered":"2024-04-25T11:03:52.467207+0000","last_clean":"2024-04-25T11:03:52.467207+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:03:52.467207+0000","last_undegraded":"2024-04-25T11:03:52.467207+0000","last_fullsized":"2024-04-25T11:03:52.467207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7614","reported_seq":7651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:56.887780+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T11:04:56.887780+0000","last_peered":"2024-04-25T11:04:56.887780+0000","last_clean":"2024-04-25T11:04:56.887780+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:04:56.887780+0000","last_undegraded":"2024-04-25T11:04:56.887780+0000","last_fullsized":"2024-04-25T11:04:56.887780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7614,"log_dups_size":0,"ondisk_log_size":7614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7610,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1853","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:23.742622+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T11:05:23.742622+0000","last_peered":"2024-04-25T11:05:23.742622+0000","last_clean":"2024-04-25T11:05:23.742622+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:23.742622+0000","last_undegraded":"2024-04-25T11:05:23.742622+0000","last_fullsized":"2024-04-25T11:05:23.742622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6812","reported_seq":6896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.661366+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T11:05:24.661366+0000","last_peered":"2024-04-25T11:05:24.661366+0000","last_clean":"2024-04-25T11:05:24.661366+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:24.661366+0000","last_undegraded":"2024-04-25T11:05:24.661366+0000","last_fullsized":"2024-04-25T11:05:24.661366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6812,"log_dups_size":0,"ondisk_log_size":6812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:51.240299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700736,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4753,"num_write_kb":142652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5972","reported_seq":6009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.617686+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T11:05:27.617686+0000","last_peered":"2024-04-25T11:05:27.617686+0000","last_clean":"2024-04-25T11:05:27.617686+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:27.617686+0000","last_undegraded":"2024-04-25T11:05:27.617686+0000","last_fullsized":"2024-04-25T11:05:27.617686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1911","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.563146+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T11:05:24.563146+0000","last_peered":"2024-04-25T11:05:24.563146+0000","last_clean":"2024-04-25T11:05:24.563146+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:24.563146+0000","last_undegraded":"2024-04-25T11:05:24.563146+0000","last_fullsized":"2024-04-25T11:05:24.563146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7355","reported_seq":7908,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.565580+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T11:05:29.565580+0000","last_peered":"2024-04-25T11:05:29.565580+0000","last_clean":"2024-04-25T11:05:29.565580+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:29.565580+0000","last_undegraded":"2024-04-25T11:05:29.565580+0000","last_fullsized":"2024-04-25T11:05:29.565580+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6321,"log_dups_size":0,"ondisk_log_size":6321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964058,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5328,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1828","reported_seq":1865,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.654563+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T11:05:24.654563+0000","last_peered":"2024-04-25T11:05:24.654563+0000","last_clean":"2024-04-25T11:05:24.654563+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:24.654563+0000","last_undegraded":"2024-04-25T11:05:24.654563+0000","last_fullsized":"2024-04-25T11:05:24.654563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1931","reported_seq":1969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.766112+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T11:05:24.766112+0000","last_peered":"2024-04-25T11:05:24.766112+0000","last_clean":"2024-04-25T11:05:24.766112+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:24.766112+0000","last_undegraded":"2024-04-25T11:05:24.766112+0000","last_fullsized":"2024-04-25T11:05:24.766112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1840","reported_seq":1878,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.406515+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T11:05:24.406515+0000","last_peered":"2024-04-25T11:05:24.406515+0000","last_clean":"2024-04-25T11:05:24.406515+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:24.406515+0000","last_undegraded":"2024-04-25T11:05:24.406515+0000","last_fullsized":"2024-04-25T11:05:24.406515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1933","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810629+0000","last_change":"2024-04-25T10:39:38.921341+0000","last_active":"2024-04-25T11:05:24.810629+0000","last_peered":"2024-04-25T11:05:24.810629+0000","last_clean":"2024-04-25T11:05:24.810629+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:24.810629+0000","last_undegraded":"2024-04-25T11:05:24.810629+0000","last_fullsized":"2024-04-25T11:05:24.810629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:26.793146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1939","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.869142+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T11:05:29.869142+0000","last_peered":"2024-04-25T11:05:29.869142+0000","last_clean":"2024-04-25T11:05:29.869142+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:29.869142+0000","last_undegraded":"2024-04-25T11:05:29.869142+0000","last_fullsized":"2024-04-25T11:05:29.869142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1939,"log_dups_size":0,"ondisk_log_size":1939,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1836","reported_seq":1874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.933110+0000","last_change":"2024-04-25T10:38:59.324885+0000","last_active":"2024-04-25T11:05:24.933110+0000","last_peered":"2024-04-25T11:05:24.933110+0000","last_clean":"2024-04-25T11:05:24.933110+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:24.933110+0000","last_undegraded":"2024-04-25T11:05:24.933110+0000","last_fullsized":"2024-04-25T11:05:24.933110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1929","reported_seq":1966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.770648+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T11:05:24.770648+0000","last_peered":"2024-04-25T11:05:24.770648+0000","last_clean":"2024-04-25T11:05:24.770648+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:24.770648+0000","last_undegraded":"2024-04-25T11:05:24.770648+0000","last_fullsized":"2024-04-25T11:05:24.770648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1929,"log_dups_size":0,"ondisk_log_size":1929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1914","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.825546+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T11:05:29.825546+0000","last_peered":"2024-04-25T11:05:29.825546+0000","last_clean":"2024-04-25T11:05:29.825546+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:29.825546+0000","last_undegraded":"2024-04-25T11:05:29.825546+0000","last_fullsized":"2024-04-25T11:05:29.825546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1866","reported_seq":1904,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.892733+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T11:05:24.892733+0000","last_peered":"2024-04-25T11:05:24.892733+0000","last_clean":"2024-04-25T11:05:24.892733+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:24.892733+0000","last_undegraded":"2024-04-25T11:05:24.892733+0000","last_fullsized":"2024-04-25T11:05:24.892733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1909","reported_seq":1945,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.836710+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T11:05:29.836710+0000","last_peered":"2024-04-25T11:05:29.836710+0000","last_clean":"2024-04-25T11:05:29.836710+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:29.836710+0000","last_undegraded":"2024-04-25T11:05:29.836710+0000","last_fullsized":"2024-04-25T11:05:29.836710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1909,"log_dups_size":0,"ondisk_log_size":1909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1912","reported_seq":1949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.613474+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T11:05:24.613474+0000","last_peered":"2024-04-25T11:05:24.613474+0000","last_clean":"2024-04-25T11:05:24.613474+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:24.613474+0000","last_undegraded":"2024-04-25T11:05:24.613474+0000","last_fullsized":"2024-04-25T11:05:24.613474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1912","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.320027+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T11:05:24.320027+0000","last_peered":"2024-04-25T11:05:24.320027+0000","last_clean":"2024-04-25T11:05:24.320027+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:24.320027+0000","last_undegraded":"2024-04-25T11:05:24.320027+0000","last_fullsized":"2024-04-25T11:05:24.320027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1892","reported_seq":1928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.461976+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T11:05:24.461976+0000","last_peered":"2024-04-25T11:05:24.461976+0000","last_clean":"2024-04-25T11:05:24.461976+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:24.461976+0000","last_undegraded":"2024-04-25T11:05:24.461976+0000","last_fullsized":"2024-04-25T11:05:24.461976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1948","reported_seq":1984,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.862095+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T11:05:24.862095+0000","last_peered":"2024-04-25T11:05:24.862095+0000","last_clean":"2024-04-25T11:05:24.862095+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:24.862095+0000","last_undegraded":"2024-04-25T11:05:24.862095+0000","last_fullsized":"2024-04-25T11:05:24.862095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1846","reported_seq":1883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.808441+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T11:05:24.808441+0000","last_peered":"2024-04-25T11:05:24.808441+0000","last_clean":"2024-04-25T11:05:24.808441+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:24.808441+0000","last_undegraded":"2024-04-25T11:05:24.808441+0000","last_fullsized":"2024-04-25T11:05:24.808441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1846,"log_dups_size":0,"ondisk_log_size":1846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:06.934419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1896","reported_seq":1933,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.609612+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T11:05:24.609612+0000","last_peered":"2024-04-25T11:05:24.609612+0000","last_clean":"2024-04-25T11:05:24.609612+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:24.609612+0000","last_undegraded":"2024-04-25T11:05:24.609612+0000","last_fullsized":"2024-04-25T11:05:24.609612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.405186+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T11:05:24.405186+0000","last_peered":"2024-04-25T11:05:24.405186+0000","last_clean":"2024-04-25T11:05:24.405186+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:24.405186+0000","last_undegraded":"2024-04-25T11:05:24.405186+0000","last_fullsized":"2024-04-25T11:05:24.405186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1945","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.340631+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T11:05:24.340631+0000","last_peered":"2024-04-25T11:05:24.340631+0000","last_clean":"2024-04-25T11:05:24.340631+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:24.340631+0000","last_undegraded":"2024-04-25T11:05:24.340631+0000","last_fullsized":"2024-04-25T11:05:24.340631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1852","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.060978+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T11:05:24.060978+0000","last_peered":"2024-04-25T11:05:24.060978+0000","last_clean":"2024-04-25T11:05:24.060978+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:24.060978+0000","last_undegraded":"2024-04-25T11:05:24.060978+0000","last_fullsized":"2024-04-25T11:05:24.060978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:07:47.192522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1875","reported_seq":1911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.847978+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T11:05:29.847978+0000","last_peered":"2024-04-25T11:05:29.847978+0000","last_clean":"2024-04-25T11:05:29.847978+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:29.847978+0000","last_undegraded":"2024-04-25T11:05:29.847978+0000","last_fullsized":"2024-04-25T11:05:29.847978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1806","reported_seq":1842,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.741424+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T11:05:24.741424+0000","last_peered":"2024-04-25T11:05:24.741424+0000","last_clean":"2024-04-25T11:05:24.741424+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:24.741424+0000","last_undegraded":"2024-04-25T11:05:24.741424+0000","last_fullsized":"2024-04-25T11:05:24.741424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1806,"log_dups_size":0,"ondisk_log_size":1806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1826","reported_seq":1861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.596582+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T11:05:24.596582+0000","last_peered":"2024-04-25T11:05:24.596582+0000","last_clean":"2024-04-25T11:05:24.596582+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:24.596582+0000","last_undegraded":"2024-04-25T11:05:24.596582+0000","last_fullsized":"2024-04-25T11:05:24.596582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1826,"log_dups_size":0,"ondisk_log_size":1826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1933","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.426459+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T11:05:24.426459+0000","last_peered":"2024-04-25T11:05:24.426459+0000","last_clean":"2024-04-25T11:05:24.426459+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:24.426459+0000","last_undegraded":"2024-04-25T11:05:24.426459+0000","last_fullsized":"2024-04-25T11:05:24.426459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1933,"log_dups_size":0,"ondisk_log_size":1933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1916","reported_seq":1951,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.619270+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T11:05:24.619270+0000","last_peered":"2024-04-25T11:05:24.619270+0000","last_clean":"2024-04-25T11:05:24.619270+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:24.619270+0000","last_undegraded":"2024-04-25T11:05:24.619270+0000","last_fullsized":"2024-04-25T11:05:24.619270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1889","reported_seq":1924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.857513+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T11:05:29.857513+0000","last_peered":"2024-04-25T11:05:29.857513+0000","last_clean":"2024-04-25T11:05:29.857513+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:29.857513+0000","last_undegraded":"2024-04-25T11:05:29.857513+0000","last_fullsized":"2024-04-25T11:05:29.857513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1847","reported_seq":1882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.751345+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T11:05:24.751345+0000","last_peered":"2024-04-25T11:05:24.751345+0000","last_clean":"2024-04-25T11:05:24.751345+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:24.751345+0000","last_undegraded":"2024-04-25T11:05:24.751345+0000","last_fullsized":"2024-04-25T11:05:24.751345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1816","reported_seq":1852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.374622+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T11:05:24.374622+0000","last_peered":"2024-04-25T11:05:24.374622+0000","last_clean":"2024-04-25T11:05:24.374622+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:24.374622+0000","last_undegraded":"2024-04-25T11:05:24.374622+0000","last_fullsized":"2024-04-25T11:05:24.374622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1913","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.717041+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T11:05:24.717041+0000","last_peered":"2024-04-25T11:05:24.717041+0000","last_clean":"2024-04-25T11:05:24.717041+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:24.717041+0000","last_undegraded":"2024-04-25T11:05:24.717041+0000","last_fullsized":"2024-04-25T11:05:24.717041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1931","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.513194+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T11:05:24.513194+0000","last_peered":"2024-04-25T11:05:24.513194+0000","last_clean":"2024-04-25T11:05:24.513194+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:24.513194+0000","last_undegraded":"2024-04-25T11:05:24.513194+0000","last_fullsized":"2024-04-25T11:05:24.513194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1971","reported_seq":2008,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.810713+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T11:05:24.810713+0000","last_peered":"2024-04-25T11:05:24.810713+0000","last_clean":"2024-04-25T11:05:24.810713+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:24.810713+0000","last_undegraded":"2024-04-25T11:05:24.810713+0000","last_fullsized":"2024-04-25T11:05:24.810713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1842","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.860274+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T11:05:24.860274+0000","last_peered":"2024-04-25T11:05:24.860274+0000","last_clean":"2024-04-25T11:05:24.860274+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:24.860274+0000","last_undegraded":"2024-04-25T11:05:24.860274+0000","last_fullsized":"2024-04-25T11:05:24.860274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1821","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:24.562050+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T11:05:24.562050+0000","last_peered":"2024-04-25T11:05:24.562050+0000","last_clean":"2024-04-25T11:05:24.562050+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:24.562050+0000","last_undegraded":"2024-04-25T11:05:24.562050+0000","last_fullsized":"2024-04-25T11:05:24.562050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1821,"log_dups_size":0,"ondisk_log_size":1821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":49853355,"num_objects":147,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151410,"num_write_kb":4113589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8327168,"data_stored":104034304,"data_compressed":4885725,"data_compressed_allocated":6918144,"data_compressed_original":102625280,"omap_allocated":0,"internal_metadata":0},"log_size":212556,"ondisk_log_size":212556,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1039,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120899,"ondisk_log_size":120899,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":241689131,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":2748,"num_read_kb":14559,"num_write":146323,"num_write_kb":1170633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":145,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304422912,"data_stored":483899944,"data_compressed":55688673,"data_compressed_allocated":82096128,"data_compressed_original":261730304,"omap_allocated":0,"internal_metadata":0},"log_size":143023,"ondisk_log_size":143023,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575172,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":753492,"kb_used_data":36492,"kb_used_omap":1,"kb_used_meta":716990,"kb_avail":93618348,"statfs":{"total":96636764160,"available":95865188352,"internally_reserved":0,"allocated":37367808,"data_stored":67646759,"data_compressed":6585493,"data_compressed_allocated":9887744,"data_compressed_original":40366080,"omap_allocated":1590,"internal_metadata":734198218},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575171,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":802736,"kb_used_data":53864,"kb_used_omap":1,"kb_used_meta":748862,"kb_avail":93569104,"statfs":{"total":96636764160,"available":95814762496,"internally_reserved":0,"allocated":55156736,"data_stored":99435836,"data_compressed":10470818,"data_compressed_allocated":15323136,"data_compressed_original":59797504,"omap_allocated":1594,"internal_metadata":766835142},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":758200,"kb_used_data":37232,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93613640,"statfs":{"total":96636764160,"available":95860367360,"internally_reserved":0,"allocated":38125568,"data_stored":72536643,"data_compressed":7445444,"data_compressed_allocated":10952704,"data_compressed_original":45559808,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575171,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":741016,"kb_used_data":42192,"kb_used_omap":1,"kb_used_meta":698814,"kb_avail":93630824,"statfs":{"total":96636764160,"available":95877963776,"internally_reserved":0,"allocated":43204608,"data_stored":75600045,"data_compressed":8104813,"data_compressed_allocated":11968512,"data_compressed_original":44556288,"omap_allocated":1594,"internal_metadata":715585990},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575171,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":838908,"kb_used_data":63796,"kb_used_omap":1,"kb_used_meta":775102,"kb_avail":93532932,"statfs":{"total":96636764160,"available":95777722368,"internally_reserved":0,"allocated":65327104,"data_stored":115587848,"data_compressed":12603349,"data_compressed_allocated":18350080,"data_compressed_original":68808704,"omap_allocated":1593,"internal_metadata":793704903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":480720,"kb_used_data":26176,"kb_used_omap":1,"kb_used_meta":454526,"kb_avail":93891120,"statfs":{"total":96636764160,"available":96144506880,"internally_reserved":0,"allocated":26804224,"data_stored":56565779,"data_compressed":5629800,"data_compressed_allocated":8048640,"data_compressed_original":38006784,"omap_allocated":1595,"internal_metadata":465435077},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575171,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":819992,"kb_used_data":22608,"kb_used_omap":1,"kb_used_meta":797374,"kb_avail":93551848,"statfs":{"total":96636764160,"available":95797092352,"internally_reserved":0,"allocated":23150592,"data_stored":52524293,"data_compressed":4801697,"data_compressed_allocated":7024640,"data_compressed_original":36601856,"omap_allocated":1595,"internal_metadata":816511429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575172,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569980,"kb_used_data":25332,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93801860,"statfs":{"total":96636764160,"available":96053104640,"internally_reserved":0,"allocated":25939968,"data_stored":50934165,"data_compressed":4989204,"data_compressed_allocated":7450624,"data_compressed_original":32641024,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21426176,"data_stored":34080905,"data_compressed":3940012,"data_compressed_allocated":5824512,"data_compressed_original":18505728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64053248,"data_stored":103270338,"data_compressed":12080873,"data_compressed_allocated":17604608,"data_compressed_original":56844288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109836,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53874688,"data_stored":86496451,"data_compressed":9867858,"data_compressed_allocated":14471168,"data_compressed_original":47112192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527526,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":970752,"data_stored":12468224,"data_compressed":586137,"data_compressed_allocated":823296,"data_compressed_original":12320768,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1421312,"data_stored":18317312,"data_compressed":861685,"data_compressed_allocated":1200128,"data_compressed_original":18096128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":823296,"data_stored":10649600,"data_compressed":500746,"data_compressed_allocated":696320,"data_compressed_original":10522624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1474560,"data_stored":15327232,"data_compressed":714334,"data_compressed_allocated":1089536,"data_compressed_original":14942208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":688128,"data_stored":8364032,"data_compressed":393015,"data_compressed_allocated":552960,"data_compressed_original":8228864,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":13688832,"data_compressed":643834,"data_compressed_allocated":892928,"data_compressed_original":13565952,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":12816384,"data_compressed":602960,"data_compressed_allocated":851968,"data_compressed_original":12685312,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":950272,"data_stored":12402688,"data_compressed":583014,"data_compressed_allocated":811008,"data_compressed_original":12263424,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:05:31.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:05:31.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.989+0000 7fc08ca00640 1 Processor -- start 2024-04-25T11:05:31.993 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.989+0000 7fc08ca00640 1 -- start start 2024-04-25T11:05:31.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc08ca00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc08815b9d0 0x7fc0880c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.995 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc08ca00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0880c97a0 0x7fc0881658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc08ca00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0880b8f60 con 0x7fc0880c7c40 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc08ca00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fc0880c9bb0 con 0x7fc0880c97a0 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc08ca00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fc0880b9ac0 con 0x7fc08815b9d0 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0880c97a0 0x7fc0881658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0880c97a0 0x7fc0881658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49564/0 (socket says 172.21.15.16:49564) 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 -- 172.21.15.16:0/1169189098 learned_addr learned my addr 172.21.15.16:0/1169189098 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc085400640 1 --2- 172.21.15.16:0/1169189098 >> v2:172.21.15.186:3300/0 conn(0x7fc08815b9d0 0x7fc0880c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 -- 172.21.15.16:0/1169189098 >> v2:172.21.15.186:3300/0 conn(0x7fc08815b9d0 msgr2=0x7fc0880c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 --2- 172.21.15.16:0/1169189098 >> v2:172.21.15.186:3300/0 conn(0x7fc08815b9d0 0x7fc0880c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 -- 172.21.15.16:0/1169189098 >> v1:172.21.15.186:6789/0 conn(0x7fc0880c7c40 legacy=0x7fc0880c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:31.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.993+0000 7fc086800640 1 -- 172.21.15.16:0/1169189098 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0880b9220 con 0x7fc0880c97a0 2024-04-25T11:05:31.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc086800640 1 --2- 172.21.15.16:0/1169189098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881658d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc088074b20 tx=0x7fc08001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785012cb40c554fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:31.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc084a00640 1 -- 172.21.15.16:0/1169189098 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800a5820 con 0x7fc0880c97a0 2024-04-25T11:05:31.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc084a00640 1 -- 172.21.15.16:0/1169189098 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0800a59c0 con 0x7fc0880c97a0 2024-04-25T11:05:31.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc084a00640 1 -- 172.21.15.16:0/1169189098 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800a5dd0 con 0x7fc0880c97a0 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- 172.21.15.16:0/1169189098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 msgr2=0x7fc0881658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 --2- 172.21.15.16:0/1169189098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881658d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc088074b20 tx=0x7fc08001ca60 comp rx=0 tx=0).stop 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- 172.21.15.16:0/1169189098 shutdown_connections 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 --2- 172.21.15.16:0/1169189098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881658d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 --2- 172.21.15.16:0/1169189098 >> v2:172.21.15.186:3300/0 conn(0x7fc08815b9d0 0x7fc0880c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- 172.21.15.16:0/1169189098 >> 172.21.15.16:0/1169189098 conn(0x7fc0880cdc80 msgr2=0x7fc0880c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- 172.21.15.16:0/1169189098 shutdown_connections 2024-04-25T11:05:32.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- 172.21.15.16:0/1169189098 wait complete. 2024-04-25T11:05:32.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 Processor -- start 2024-04-25T11:05:32.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:31.997+0000 7fc08ca00640 1 -- start start 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0880c7c40 0x7fc0881ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc08815b9d0 0x7fc088164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fc0880c8150 con 0x7fc0880c97a0 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc08815bde0 con 0x7fc0880c7c40 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc0880c82d0 con 0x7fc08815b9d0 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49572/0 (socket says 172.21.15.16:49572) 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 -- 172.21.15.16:0/3414498220 learned_addr learned my addr 172.21.15.16:0/3414498220 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085e00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0880c7c40 0x7fc0881ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:32.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc086800640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc08815b9d0 0x7fc088164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:32.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 -- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc08815b9d0 msgr2=0x7fc088164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:32.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc08815b9d0 0x7fc088164e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 -- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0880c7c40 msgr2=0x7fc0881ff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0880c7c40 0x7fc0881ff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 -- 172.21.15.16:0/3414498220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088142890 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc085400640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d800 tx=0x7fc07400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400b8d0 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074019070 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0881fee30 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400bc90 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08813c470 con 0x7fc0880c97a0 2024-04-25T11:05:32.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.001+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0880c43c0 con 0x7fc0880c97a0 2024-04-25T11:05:32.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.005+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc07401e460 con 0x7fc0880c97a0 2024-04-25T11:05:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.005+0000 7fc07e000640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 0x7fc060071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.005+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc07408fb40 con 0x7fc0880c97a0 2024-04-25T11:05:32.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.005+0000 7fc085e00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 0x7fc060071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:32.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.005+0000 7fc085e00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 0x7fc060071ab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc078001800 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:32.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.009+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0881fee30 con 0x7fc0880c97a0 2024-04-25T11:05:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0880009a0 con 0x7fc0880c97a0 2024-04-25T11:05:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc07e000640 1 -- 172.21.15.16:0/3414498220 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18891 (secure 0 0 0) 0x7fc07405bf90 con 0x7fc0880c97a0 2024-04-25T11:05:32.180 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:32.181 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:38.897256+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 msgr2=0x7fc060071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 0x7fc060071ab0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc078001800 tx=0x7fc078009040 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 msgr2=0x7fc0881384b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.177+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d800 tx=0x7fc07400dcc0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 shutdown_connections 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fc06006f5a0 0x7fc060071ab0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc08815b9d0 0x7fc088164e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0880c97a0 0x7fc0881384b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 --2- 172.21.15.16:0/3414498220 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0880c7c40 0x7fc0881ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 >> 172.21.15.16:0/3414498220 conn(0x7fc0880cdc80 msgr2=0x7fc08815a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 shutdown_connections 2024-04-25T11:05:32.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:32.181+0000 7fc08ca00640 1 -- 172.21.15.16:0/3414498220 wait complete. 2024-04-25T11:05:33.204 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T11:05:33.204 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 Processor -- start 2024-04-25T11:05:33.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 -- start start 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7efffc1667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc15e610 con 0x7efffc155120 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc15e8b0 con 0x7efffc15b980 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0004800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efffc15eb90 con 0x7efffc0ca850 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0001400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efffc155120 0x7efffc0ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35804/0 (socket says 172.21.15.16:35804) 2024-04-25T11:05:33.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0001400640 1 -- 172.21.15.16:0/2389454622 learned_addr learned my addr 172.21.15.16:0/2389454622 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:33.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0002800640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7efffc1667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379626251 0 0) 0x7efffc15e610 con 0x7efffc155120 2024-04-25T11:05:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe40035c0 con 0x7efffc155120 2024-04-25T11:05:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738001087 0 0) 0x7efffc15e8b0 con 0x7efffc15b980 2024-04-25T11:05:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efffc15e610 con 0x7efffc15b980 2024-04-25T11:05:33.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 917764645 0 0) 0x7effe40035c0 con 0x7efffc155120 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 msgr2=0x7efffc1667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7efffc1667d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.373+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 >> v1:172.21.15.186:6789/0 conn(0x7efffc15b980 legacy=0x7efffc0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc15ee70 con 0x7efffc155120 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7effec0016f0 con 0x7efffc155120 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0002800640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7efffc1667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 >> v1:172.21.15.16:6789/0 conn(0x7efffc155120 legacy=0x7efffc0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4003c10 0x7effe4004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe40048a0 0x7effe4004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7effe4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efffc15eb90 con 0x7effe4003c10 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7effe400bb10 con 0x7effe40048a0 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7effe400bd10 con 0x7efffc0ca850 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4003c10 0x7effe4004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001400640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe40048a0 0x7effe4004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0002800640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7effe4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 -- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 msgr2=0x7effe4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7effe4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 -- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe40048a0 msgr2=0x7effe4004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7effe40048a0 0x7effe4004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 -- 172.21.15.16:0/2389454622 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe40035c0 con 0x7effe4003c10 2024-04-25T11:05:33.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0002800640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc0ca850 0x7effe4005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0001e00640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4003c10 0x7effe4004040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efff0001990 tx=0x7efff001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90df410a1f11185 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0001570 con 0x7effe4003c10 2024-04-25T11:05:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff00052d0 con 0x7effe4003c10 2024-04-25T11:05:33.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.377+0000 7f0000a00640 1 -- 172.21.15.16:0/2389454622 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff00a89b0 con 0x7effe4003c10 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- 172.21.15.16:0/2389454622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4003c10 msgr2=0x7effe4004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 --2- 172.21.15.16:0/2389454622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7effe4003c10 0x7effe4004040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efff0001990 tx=0x7efff001ed50 comp rx=0 tx=0).stop 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0002800640 1 -- 172.21.15.16:0/2389454622 reap_dead start 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- 172.21.15.16:0/2389454622 shutdown_connections 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- 172.21.15.16:0/2389454622 >> 172.21.15.16:0/2389454622 conn(0x7efffc073160 msgr2=0x7efffc073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- 172.21.15.16:0/2389454622 shutdown_connections 2024-04-25T11:05:33.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- 172.21.15.16:0/2389454622 wait complete. 2024-04-25T11:05:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 Processor -- start 2024-04-25T11:05:33.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.381+0000 7f0004800640 1 -- start start 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc15c060 0x7efffc14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 0x7efffc1eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efffc1eb2f0 0x7efffc06e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7efffc155530 con 0x7efffc15c820 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efffc15bd90 con 0x7efffc1eb2f0 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efffc0c91a0 con 0x7efffc15c060 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 0x7efffc1eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 0x7efffc1eadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49580/0 (socket says 172.21.15.16:49580) 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 -- 172.21.15.16:0/4231977547 learned_addr learned my addr 172.21.15.16:0/4231977547 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001e00640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc15c060 0x7efffc14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0002800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efffc1eb2f0 0x7efffc06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 -- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc15c060 msgr2=0x7efffc14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc15c060 0x7efffc14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 -- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efffc1eb2f0 msgr2=0x7efffc06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efffc1eb2f0 0x7efffc06e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc06df40 con 0x7efffc15c820 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001e00640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efffc15c060 0x7efffc14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:33.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0001400640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 0x7efffc1eadb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effec0018a0 tx=0x7effec0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec00f9c0 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effec018070 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec00fd60 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc1fbb40 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efffc1fc3e0 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.385+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efffc050750 con 0x7efffc15c820 2024-04-25T11:05:33.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7effec01d460 con 0x7efffc15c820 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7effd806f5a0 0x7effd8071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7effec08f7c0 con 0x7efffc15c820 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7effd8079050 0x7effd807b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effec01be80 con 0x7effd8079050 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effec096050 con 0x7efffc15c820 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7f0001e00640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7effd806f5a0 0x7effd8071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7f0002800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7effd8079050 0x7effd807b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7f0002800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7effd8079050 0x7effd807b540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7f0001e00640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7effd806f5a0 0x7effd8071ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efff0001960 tx=0x7efff00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.389+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== osd.0 v2:172.21.15.16:6800/641177332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effec01be80 con 0x7effd8079050 2024-04-25T11:05:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 --> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efffc15cc30 con 0x7effd8079050 2024-04-25T11:05:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7efff6000640 1 -- 172.21.15.16:0/4231977547 <== osd.0 v2:172.21.15.16:6800/641177332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efffc15cc30 con 0x7effd8079050 2024-04-25T11:05:33.407 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:33.407 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:33.408 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7effd8079050 msgr2=0x7effd807b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:6800/641177332,v1:172.21.15.16:6801/641177332] conn(0x7effd8079050 0x7effd807b540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7effd806f5a0 msgr2=0x7effd8071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7effd806f5a0 0x7effd8071ab0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efff0001960 tx=0x7efff00aa070 comp rx=0 tx=0).stop 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 msgr2=0x7efffc1eadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 --2- 172.21.15.16:0/4231977547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efffc15c820 0x7efffc1eadb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7effec0018a0 tx=0x7effec0077a0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0002800640 1 -- 172.21.15.16:0/4231977547 reap_dead start 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 shutdown_connections 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 >> 172.21.15.16:0/4231977547 conn(0x7efffc073160 msgr2=0x7efffc15af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 shutdown_connections 2024-04-25T11:05:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.405+0000 7f0004800640 1 -- 172.21.15.16:0/4231977547 wait complete. 2024-04-25T11:05:33.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T11:05:33.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 Processor -- start 2024-04-25T11:05:33.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 -- start start 2024-04-25T11:05:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f12b4168900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b406ca80 con 0x7f12b406c670 2024-04-25T11:05:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b40c8b70 con 0x7f12b40c7ae0 2024-04-25T11:05:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b9200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f12b415d9f0 con 0x7f12b40c4fd0 2024-04-25T11:05:33.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12aaa00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f12b406c670 0x7f12b40c5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35812/0 (socket says 172.21.15.16:35812) 2024-04-25T11:05:33.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12aaa00640 1 -- 172.21.15.16:0/1834248486 learned_addr learned my addr 172.21.15.16:0/1834248486 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b3e00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f12b4168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856261527 0 0) 0x7f129c001170 con 0x7f12b406c670 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12980035c0 con 0x7f12b406c670 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168978347 0 0) 0x7f12b40c8b70 con 0x7f12b40c7ae0 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c001170 con 0x7f12b40c7ae0 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 542385356 0 0) 0x7f12980035c0 con 0x7f12b406c670 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 msgr2=0x7f12b4168900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f12b4168900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 >> v1:172.21.15.186:6789/0 conn(0x7f12b40c7ae0 legacy=0x7f12b40c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b40c53e0 con 0x7f12b406c670 2024-04-25T11:05:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f129c0018a0 con 0x7f12b406c670 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 >> v1:172.21.15.16:6789/0 conn(0x7f12b406c670 legacy=0x7f12b40c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1298003c10 0x7f1298004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12980048a0 0x7f1298004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f1298005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f129800bb40 con 0x7f12980048a0 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f129800bcf0 con 0x7f1298003c10 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f129800bef0 con 0x7f12b40c4fd0 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12aaa00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12980048a0 0x7f1298004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b3e00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f1298005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.581+0000 7f12b3400640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1298003c10 0x7f1298004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 -- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 msgr2=0x7f1298005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f1298005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 -- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1298003c10 msgr2=0x7f1298004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:33.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1298003c10 0x7f1298004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 -- 172.21.15.16:0/1834248486 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12980035c0 con 0x7f12980048a0 2024-04-25T11:05:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b3e00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12b40c4fd0 0x7f1298005280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b3400640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1298003c10 0x7f1298004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12aaa00640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12980048a0 0x7f1298004cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f12b40708e0 tx=0x7f129c01cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a97efda0fa99899 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c00c120 con 0x7f12980048a0 2024-04-25T11:05:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c0a9020 con 0x7f12980048a0 2024-04-25T11:05:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b2a00640 1 -- 172.21.15.16:0/1834248486 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0a5cc0 con 0x7f12980048a0 2024-04-25T11:05:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 -- 172.21.15.16:0/1834248486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12980048a0 msgr2=0x7f1298004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 --2- 172.21.15.16:0/1834248486 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12980048a0 0x7f1298004cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f12b40708e0 tx=0x7f129c01cd40 comp rx=0 tx=0).stop 2024-04-25T11:05:33.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b3e00640 1 -- 172.21.15.16:0/1834248486 reap_dead start 2024-04-25T11:05:33.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 -- 172.21.15.16:0/1834248486 shutdown_connections 2024-04-25T11:05:33.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 -- 172.21.15.16:0/1834248486 >> 172.21.15.16:0/1834248486 conn(0x7f12b4074550 msgr2=0x7f12b40cd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:33.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 -- 172.21.15.16:0/1834248486 shutdown_connections 2024-04-25T11:05:33.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.585+0000 7f12b9200640 1 -- 172.21.15.16:0/1834248486 wait complete. 2024-04-25T11:05:33.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 Processor -- start 2024-04-25T11:05:33.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 -- start start 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12980048a0 0x7f12b414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12b41584e0 0x7f12b415b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12b40c64f0 con 0x7f12b4157860 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f12b415dee0 con 0x7f12b41584e0 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.589+0000 7f12b9200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f12b40c9d50 con 0x7f12980048a0 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49604/0 (socket says 172.21.15.16:49604) 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 -- 172.21.15.16:0/2110903264 learned_addr learned my addr 172.21.15.16:0/2110903264 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12b3400640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12980048a0 0x7f12b414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12b3e00640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12b41584e0 0x7f12b415b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 -- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12980048a0 msgr2=0x7f12b414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12980048a0 0x7f12b414b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 -- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12b41584e0 msgr2=0x7f12b415b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12b41584e0 0x7f12b415b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 -- 172.21.15.16:0/2110903264 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b41fc220 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12aaa00640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f129c01cb70 tx=0x7f12980058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c0a6e80 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129c004a40 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b41566a0 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129c007090 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b41560e0 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b4157f80 con 0x7f12b4157860 2024-04-25T11:05:33.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.593+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f129c0072f0 con 0x7f12b4157860 2024-04-25T11:05:33.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.597+0000 7f12abe00640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 0x7f128c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:33.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.597+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f129c129520 con 0x7f12b4157860 2024-04-25T11:05:33.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.597+0000 7f12b3400640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 0x7f128c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:33.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.597+0000 7f12b3400640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 0x7f128c071ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007fd0 tx=0x7f12a40074a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:33.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.601+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12b406ca80 con 0x7f12b4157860 2024-04-25T11:05:33.769 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.765+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f12b4155170 con 0x7f128c06f5a0 2024-04-25T11:05:33.839 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12abe00640 1 -- 172.21.15.16:0/2110903264 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12b4155170 con 0x7f128c06f5a0 2024-04-25T11:05:33.839 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T11:05:33.841 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 msgr2=0x7f128c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 0x7f128c071ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f12a4007fd0 tx=0x7f12a40074a0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 msgr2=0x7f12b41fbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f129c01cb70 tx=0x7f12980058d0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 shutdown_connections 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f128c06f5a0 0x7f128c071ab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12b41584e0 0x7f12b415b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12b4157860 0x7f12b41fbce0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 --2- 172.21.15.16:0/2110903264 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12980048a0 0x7f12b414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 >> 172.21.15.16:0/2110903264 conn(0x7f12b4074550 msgr2=0x7f12b414d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 shutdown_connections 2024-04-25T11:05:33.842 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:33.841+0000 7f12b9200640 1 -- 172.21.15.16:0/2110903264 wait complete. 2024-04-25T11:05:33.862 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T11:05:33.862 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:34.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.013+0000 7fddda200640 1 Processor -- start 2024-04-25T11:05:34.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.013+0000 7fddda200640 1 -- start start 2024-04-25T11:05:34.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddda200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddd40c6db0 0x7fddd4154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddda200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd415b8b0 0x7fddd40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddda200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd4155780 con 0x7fddd4155370 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddda200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40cc7a0 con 0x7fddd40c6db0 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddda200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fddd415f2e0 con 0x7fddd415b8b0 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddd40c6db0 0x7fddd4154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fddd40c6db0 0x7fddd4154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49608/0 (socket says 172.21.15.16:49608) 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 -- 172.21.15.16:0/821927401 learned_addr learned my addr 172.21.15.16:0/821927401 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3e00640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd415b8b0 0x7fddd40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 -- 172.21.15.16:0/821927401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd415b8b0 msgr2=0x7fddd40cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd415b8b0 0x7fddd40cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 -- 172.21.15.16:0/821927401 >> v1:172.21.15.16:6789/0 conn(0x7fddd4155370 legacy=0x7fddd415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.017+0000 7fddd3400640 1 -- 172.21.15.16:0/821927401 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd415e6d0 con 0x7fddd40c6db0 2024-04-25T11:05:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddd3400640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd40c6db0 0x7fddd4154e30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddc40099d0 tx=0x7fddc401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7c18d4dc95e418 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddd2a00640 1 -- 172.21.15.16:0/821927401 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40a9680 con 0x7fddd40c6db0 2024-04-25T11:05:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddd2a00640 1 -- 172.21.15.16:0/821927401 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc40a9820 con 0x7fddd40c6db0 2024-04-25T11:05:34.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddd2a00640 1 -- 172.21.15.16:0/821927401 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40a9c30 con 0x7fddd40c6db0 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 -- 172.21.15.16:0/821927401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd40c6db0 msgr2=0x7fddd4154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd40c6db0 0x7fddd4154e30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddc40099d0 tx=0x7fddc401c5c0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 -- 172.21.15.16:0/821927401 shutdown_connections 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd415b8b0 0x7fddd40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 --2- 172.21.15.16:0/821927401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd40c6db0 0x7fddd4154e30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 -- 172.21.15.16:0/821927401 >> 172.21.15.16:0/821927401 conn(0x7fddd40732d0 msgr2=0x7fddd40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 -- 172.21.15.16:0/821927401 shutdown_connections 2024-04-25T11:05:34.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 -- 172.21.15.16:0/821927401 wait complete. 2024-04-25T11:05:34.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.021+0000 7fddda200640 1 Processor -- start 2024-04-25T11:05:34.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- start start 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddd40c6db0 0x7fddd4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd4155370 0x7fddd41ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 0x7fddd414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41678e0 con 0x7fddd415b8b0 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40c7690 con 0x7fddd40c6db0 2024-04-25T11:05:34.031 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fddd4167a60 con 0x7fddd4155370 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 0x7fddd414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 0x7fddd414c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49620/0 (socket says 172.21.15.16:49620) 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 -- 172.21.15.16:0/2977948451 learned_addr learned my addr 172.21.15.16:0/2977948451 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3400640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddd40c6db0 0x7fddd4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddcbe00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd4155370 0x7fddd41ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 -- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd4155370 msgr2=0x7fddd41ff0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fddd4155370 0x7fddd41ff0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 -- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddd40c6db0 msgr2=0x7fddd4146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fddd40c6db0 0x7fddd4146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd41ff630 con 0x7fddd415b8b0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddd3e00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 0x7fddd414c300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddcc007eb0 tx=0x7fddcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc014620 con 0x7fddd415b8b0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc019070 con 0x7fddd415b8b0 2024-04-25T11:05:34.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd414bad0 con 0x7fddd415b8b0 2024-04-25T11:05:34.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0149e0 con 0x7fddd415b8b0 2024-04-25T11:05:34.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41fe8f0 con 0x7fddd415b8b0 2024-04-25T11:05:34.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.025+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddd414bff0 con 0x7fddd415b8b0 2024-04-25T11:05:34.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fddcc014c40 con 0x7fddd415b8b0 2024-04-25T11:05:34.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fddac06f5a0 0x7fddac071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.034 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fddcc08ffa0 con 0x7fddd415b8b0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7fddac079050 0x7fddac07b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddcc00be50 con 0x7fddac079050 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddcc0925c0 con 0x7fddd415b8b0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddd3400640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fddac06f5a0 0x7fddac071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcbe00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7fddac079050 0x7fddac07b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcbe00640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7fddac079050 0x7fddac07b540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddd3400640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fddac06f5a0 0x7fddac071ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ae000 tx=0x7fddc40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.029+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== osd.1 v2:172.21.15.16:6816/2432671157 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fddcc00be50 con 0x7fddac079050 2024-04-25T11:05:34.047 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 --> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fddd4050750 con 0x7fddac079050 2024-04-25T11:05:34.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddcb400640 1 -- 172.21.15.16:0/2977948451 <== osd.1 v2:172.21.15.16:6816/2432671157 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fddd4050750 con 0x7fddac079050 2024-04-25T11:05:34.048 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:34.048 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:34.048 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7fddac079050 msgr2=0x7fddac07b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:6816/2432671157,v1:172.21.15.16:6817/2432671157] conn(0x7fddac079050 0x7fddac07b540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fddac06f5a0 msgr2=0x7fddac071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fddac06f5a0 0x7fddac071ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddc40ae000 tx=0x7fddc40a7000 comp rx=0 tx=0).stop 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 msgr2=0x7fddd414c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 --2- 172.21.15.16:0/2977948451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fddd415b8b0 0x7fddd414c300 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fddcc007eb0 tx=0x7fddcc00e4b0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddd3e00640 1 -- 172.21.15.16:0/2977948451 reap_dead start 2024-04-25T11:05:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 shutdown_connections 2024-04-25T11:05:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 >> 172.21.15.16:0/2977948451 conn(0x7fddd40732d0 msgr2=0x7fddd41642e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 shutdown_connections 2024-04-25T11:05:34.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.045+0000 7fddda200640 1 -- 172.21.15.16:0/2977948451 wait complete. 2024-04-25T11:05:34.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T11:05:34.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.217+0000 7f0d87600640 1 Processor -- start 2024-04-25T11:05:34.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.217+0000 7f0d87600640 1 -- start start 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d87600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0d801648d0 0x7f0d80166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d87600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d800b8f60 con 0x7f0d800c7c40 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d87600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d800b9220 con 0x7f0d8015b9d0 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d87600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0d800b9ac0 con 0x7f0d801648d0 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d84c00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0d800c7c40 0x7f0d800c68f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35832/0 (socket says 172.21.15.16:35832) 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d84c00640 1 -- 172.21.15.16:0/318344266 learned_addr learned my addr 172.21.15.16:0/318344266 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 --2- 172.21.15.16:0/318344266 >> v2:172.21.15.186:3300/0 conn(0x7f0d801648d0 0x7f0d80166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122595610 0 0) 0x7f0d800b8f60 con 0x7f0d800c7c40 2024-04-25T11:05:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d640035c0 con 0x7f0d800c7c40 2024-04-25T11:05:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33433123 0 0) 0x7f0d800b9220 con 0x7f0d8015b9d0 2024-04-25T11:05:34.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d800b8f60 con 0x7f0d8015b9d0 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126315753 0 0) 0x7f0d640035c0 con 0x7f0d800c7c40 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 >> v2:172.21.15.186:3300/0 conn(0x7f0d801648d0 msgr2=0x7f0d80166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 --2- 172.21.15.16:0/318344266 >> v2:172.21.15.186:3300/0 conn(0x7f0d801648d0 0x7f0d80166cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 >> v1:172.21.15.186:6789/0 conn(0x7f0d8015b9d0 legacy=0x7f0d800c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d800b9500 con 0x7f0d800c7c40 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f0d700016d0 con 0x7f0d800c7c40 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 >> v1:172.21.15.16:6789/0 conn(0x7f0d800c7c40 legacy=0x7f0d800c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64003be0 0x7f0d64003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d640048a0 0x7f0d64004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 0x7f0d6400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d800b9ac0 con 0x7f0d64005290 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6400c230 con 0x7f0d64003be0 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6400c430 con 0x7f0d640048a0 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 0x7f0d6400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d84c00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64003be0 0x7f0d64003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d77e00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d640048a0 0x7f0d64004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 -- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d640048a0 msgr2=0x7f0d64004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d640048a0 0x7f0d64004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 -- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64003be0 msgr2=0x7f0d64003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64003be0 0x7f0d64003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d85600640 1 -- 172.21.15.16:0/318344266 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d640035c0 con 0x7f0d64005290 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.221+0000 7f0d77e00640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d640048a0 0x7f0d64004cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:34.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d85600640 1 -- 172.21.15.16:0/318344266 reap_dead start 2024-04-25T11:05:34.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d85600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 0x7f0d6400ba60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fd0 tx=0x7f0d7801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55164e170294473 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78009ca0 con 0x7f0d64005290 2024-04-25T11:05:34.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d780a5d10 con 0x7f0d64005290 2024-04-25T11:05:34.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d7fe00640 1 -- 172.21.15.16:0/318344266 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78003bc0 con 0x7f0d64005290 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 -- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 msgr2=0x7f0d6400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 0x7f0d6400ba60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009fd0 tx=0x7f0d7801cd00 comp rx=0 tx=0).stop 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 -- 172.21.15.16:0/318344266 shutdown_connections 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 --2- 172.21.15.16:0/318344266 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d64005290 0x7f0d6400ba60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 -- 172.21.15.16:0/318344266 >> 172.21.15.16:0/318344266 conn(0x7f0d800cdc80 msgr2=0x7f0d800c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 -- 172.21.15.16:0/318344266 shutdown_connections 2024-04-25T11:05:34.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.225+0000 7f0d87600640 1 -- 172.21.15.16:0/318344266 wait complete. 2024-04-25T11:05:34.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 Processor -- start 2024-04-25T11:05:34.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 -- start start 2024-04-25T11:05:34.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 0x7f0d80158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 0x7f0d801ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8015bde0 con 0x7f0d800c3f30 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0d800bab70 con 0x7f0d64005290 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d87600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0d800c8150 con 0x7f0d80141970 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.229+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49642/0 (socket says 172.21.15.16:49642) 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 -- 172.21.15.16:0/4036031157 learned_addr learned my addr 172.21.15.16:0/4036031157 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d84c00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 0x7f0d80158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d85600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 0x7f0d801ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 -- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 msgr2=0x7f0d801ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 0x7f0d801ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 -- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 msgr2=0x7f0d80158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 0x7f0d80158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 -- 172.21.15.16:0/4036031157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d80156de0 con 0x7f0d800c3f30 2024-04-25T11:05:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d85600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 0x7f0d801ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d84c00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 0x7f0d80158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d77e00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d68011d50 tx=0x7f0d6800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68010040 con 0x7f0d800c3f30 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6801a070 con 0x7f0d800c3f30 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800fe60 con 0x7f0d800c3f30 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d801570c0 con 0x7f0d800c3f30 2024-04-25T11:05:34.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d80157f60 con 0x7f0d800c3f30 2024-04-25T11:05:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d80156b50 con 0x7f0d800c3f30 2024-04-25T11:05:34.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.233+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0d680158d0 con 0x7f0d800c3f30 2024-04-25T11:05:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.237+0000 7f0d7d600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 0x7f0d58071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.237+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f0d68092ef0 con 0x7f0d800c3f30 2024-04-25T11:05:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.237+0000 7f0d84c00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 0x7f0d58071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.237+0000 7f0d84c00640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 0x7f0d58071ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001140 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.242 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.241+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d6805f9f0 con 0x7f0d800c3f30 2024-04-25T11:05:34.467 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0d801591b0 con 0x7f0d5806f5d0 2024-04-25T11:05:34.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d7d600640 1 -- 172.21.15.16:0/4036031157 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0d801591b0 con 0x7f0d5806f5d0 2024-04-25T11:05:34.468 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T11:05:34.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 msgr2=0x7f0d58071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 0x7f0d58071ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001140 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 msgr2=0x7f0d801ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.465+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d68011d50 tx=0x7f0d6800f540 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 shutdown_connections 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f0d5806f5d0 0x7f0d58071ae0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0d80141970 0x7f0d801ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d800c3f30 0x7f0d801ecf30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 --2- 172.21.15.16:0/4036031157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d64005290 0x7f0d80158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 >> 172.21.15.16:0/4036031157 conn(0x7f0d800cdc80 msgr2=0x7f0d8015a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 shutdown_connections 2024-04-25T11:05:34.471 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.469+0000 7f0d87600640 1 -- 172.21.15.16:0/4036031157 wait complete. 2024-04-25T11:05:34.491 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T11:05:34.491 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:34.647 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 Processor -- start 2024-04-25T11:05:34.648 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 -- start start 2024-04-25T11:05:34.649 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9400c9250 0x7fa9400c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9400c5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9400cdb40 con 0x7fa94015a7f0 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa9400cd8f0 con 0x7fa9400c9250 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa948800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa9400c86b0 con 0x7fa9400c4c20 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa945400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9400c9250 0x7fa9400c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa946800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9400c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa945400640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa9400c9250 0x7fa9400c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.16:44818/0 (socket says 172.21.15.16:44818) 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa945400640 1 -- 172.21.15.16:0/1790589645 learned_addr learned my addr 172.21.15.16:0/1790589645 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.650 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.645+0000 7fa946800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9400c5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:49160/0 (socket says 172.21.15.16:49160) 2024-04-25T11:05:34.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa945400640 1 -- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 msgr2=0x7fa9400c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:34.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa945400640 1 --2- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9400c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa945400640 1 -- 172.21.15.16:0/1790589645 >> v1:172.21.15.186:6789/0 conn(0x7fa94015a7f0 legacy=0x7fa9400c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa945400640 1 -- 172.21.15.16:0/1790589645 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9400c7d80 con 0x7fa9400c9250 2024-04-25T11:05:34.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa945400640 1 --2- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa9400c46e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9300099d0 tx=0x7fa93001ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3b42b95a4697cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.653 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa944a00640 1 -- 172.21.15.16:0/1790589645 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9300b5070 con 0x7fa9400c9250 2024-04-25T11:05:34.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa944a00640 1 -- 172.21.15.16:0/1790589645 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9300a8b70 con 0x7fa9400c9250 2024-04-25T11:05:34.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa944a00640 1 -- 172.21.15.16:0/1790589645 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9300b0440 con 0x7fa9400c9250 2024-04-25T11:05:34.654 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa948800640 1 -- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 msgr2=0x7fa9400c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.649+0000 7fa948800640 1 --2- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa9400c46e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa9300099d0 tx=0x7fa93001ee70 comp rx=0 tx=0).stop 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 -- 172.21.15.16:0/1790589645 shutdown_connections 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 --2- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9400c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 --2- 172.21.15.16:0/1790589645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa9400c46e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 -- 172.21.15.16:0/1790589645 >> 172.21.15.16:0/1790589645 conn(0x7fa94006cc70 msgr2=0x7fa9400cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 -- 172.21.15.16:0/1790589645 shutdown_connections 2024-04-25T11:05:34.655 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 -- 172.21.15.16:0/1790589645 wait complete. 2024-04-25T11:05:34.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 Processor -- start 2024-04-25T11:05:34.657 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.653+0000 7fa948800640 1 -- start start 2024-04-25T11:05:34.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9401473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa94014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.659 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 0x7fa94014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa94015ac00 con 0x7fa94015a7f0 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa9400c8340 con 0x7fa9400c9250 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa9400c9a10 con 0x7fa9400c4c20 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 0x7fa94014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 0x7fa94014ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44648/0 (socket says 172.21.15.16:44648) 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 -- 172.21.15.16:0/778461119 learned_addr learned my addr 172.21.15.16:0/778461119 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa945e00640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9401473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa945400640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa94014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 -- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 msgr2=0x7fa9401473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa9400c4c20 0x7fa9401473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 -- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 msgr2=0x7fa94014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa94014e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9401586b0 con 0x7fa94015a7f0 2024-04-25T11:05:34.660 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa945400640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9400c9250 0x7fa94014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:34.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa946800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 0x7fa94014ed20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00ede0 tx=0x7fa93c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c018020 con 0x7fa94015a7f0 2024-04-25T11:05:34.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9401f7f40 con 0x7fa94015a7f0 2024-04-25T11:05:34.661 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa93c014480 con 0x7fa94015a7f0 2024-04-25T11:05:34.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c014870 con 0x7fa94015a7f0 2024-04-25T11:05:34.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94014fe90 con 0x7fa94015a7f0 2024-04-25T11:05:34.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa9401f7a00 con 0x7fa94015a7f0 2024-04-25T11:05:34.662 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.657+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa93c01b020 con 0x7fa94015a7f0 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa91c06f5a0 0x7fa91c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa93c0905c0 con 0x7fa94015a7f0 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa945e00640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa91c06f5a0 0x7fa91c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7fa91c078fc0 0x7fa91c07b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa91c07bbc0 con 0x7fa91c078fc0 2024-04-25T11:05:34.664 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa93c097050 con 0x7fa94015a7f0 2024-04-25T11:05:34.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa945400640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7fa91c078fc0 0x7fa91c07b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa945e00640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa91c06f5a0 0x7fa91c071ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa9400b9880 tx=0x7fa934009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.665 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa945400640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7fa91c078fc0 0x7fa91c07b4b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.666 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.661+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== osd.2 v2:172.21.15.16:6808/659353344 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa91c07bbc0 con 0x7fa91c078fc0 2024-04-25T11:05:34.679 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 --> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa940050750 con 0x7fa91c078fc0 2024-04-25T11:05:34.680 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa93a000640 1 -- 172.21.15.16:0/778461119 <== osd.2 v2:172.21.15.16:6808/659353344 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa940050750 con 0x7fa91c078fc0 2024-04-25T11:05:34.680 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:34.680 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:34.680 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7fa91c078fc0 msgr2=0x7fa91c07b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:6808/659353344,v1:172.21.15.16:6809/659353344] conn(0x7fa91c078fc0 0x7fa91c07b4b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa91c06f5a0 msgr2=0x7fa91c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa91c06f5a0 0x7fa91c071ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa9400b9880 tx=0x7fa934009040 comp rx=0 tx=0).stop 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 msgr2=0x7fa94014ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 --2- 172.21.15.16:0/778461119 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa94015a7f0 0x7fa94014ed20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00ede0 tx=0x7fa93c00c490 comp rx=0 tx=0).stop 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa946800640 1 -- 172.21.15.16:0/778461119 reap_dead start 2024-04-25T11:05:34.681 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 shutdown_connections 2024-04-25T11:05:34.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 >> 172.21.15.16:0/778461119 conn(0x7fa94006cc70 msgr2=0x7fa94014bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 shutdown_connections 2024-04-25T11:05:34.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.677+0000 7fa948800640 1 -- 172.21.15.16:0/778461119 wait complete. 2024-04-25T11:05:34.700 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T11:05:34.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.849+0000 7f19a2600640 1 Processor -- start 2024-04-25T11:05:34.853 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.849+0000 7f19a2600640 1 -- start start 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f19a2600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f199c0c7c40 0x7f199c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f19a2600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c0b8f60 con 0x7f199c0c6d00 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f19a2600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c0b9220 con 0x7f199c0c68f0 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f19a2600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f199c0b9ac0 con 0x7f199c0c7c40 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f199c0c7c40 0x7f199c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f199c0c7c40 0x7f199c15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44650/0 (socket says 172.21.15.16:44650) 2024-04-25T11:05:34.855 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 -- 172.21.15.16:0/3470944669 learned_addr learned my addr 172.21.15.16:0/3470944669 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 -- 172.21.15.16:0/3470944669 >> v1:172.21.15.186:6789/0 conn(0x7f199c0c68f0 legacy=0x7f199c0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 -- 172.21.15.16:0/3470944669 >> v1:172.21.15.16:6789/0 conn(0x7f199c0c6d00 legacy=0x7f199c1658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.856 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.853+0000 7f199b400640 1 -- 172.21.15.16:0/3470944669 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c0b9500 con 0x7f199c0c7c40 2024-04-25T11:05:34.858 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f199b400640 1 --2- 172.21.15.16:0/3470944669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c7c40 0x7f199c15b9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f198c0099d0 tx=0x7f198c01c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79ee83de4c9a576 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f199aa00640 1 -- 172.21.15.16:0/3470944669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ab5f0 con 0x7f199c0c7c40 2024-04-25T11:05:34.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f199aa00640 1 -- 172.21.15.16:0/3470944669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c0b0070 con 0x7f199c0c7c40 2024-04-25T11:05:34.859 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f199aa00640 1 -- 172.21.15.16:0/3470944669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c0ab9f0 con 0x7f199c0c7c40 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- 172.21.15.16:0/3470944669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c7c40 msgr2=0x7f199c15b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 --2- 172.21.15.16:0/3470944669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c7c40 0x7f199c15b9d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f198c0099d0 tx=0x7f198c01c5f0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- 172.21.15.16:0/3470944669 shutdown_connections 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 --2- 172.21.15.16:0/3470944669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c7c40 0x7f199c15b9d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- 172.21.15.16:0/3470944669 >> 172.21.15.16:0/3470944669 conn(0x7f199c0cdc80 msgr2=0x7f199c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- 172.21.15.16:0/3470944669 shutdown_connections 2024-04-25T11:05:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- 172.21.15.16:0/3470944669 wait complete. 2024-04-25T11:05:34.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 Processor -- start 2024-04-25T11:05:34.862 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.857+0000 7f19a2600640 1 -- start start 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 0x7f199c134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f199c0c7c40 0x7f199c135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f199c0c82d0 con 0x7f199c0c6d00 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f199c0c8150 con 0x7f199c0c68f0 2024-04-25T11:05:34.865 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f199c0c9970 con 0x7f199c0c7c40 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44652/0 (socket says 172.21.15.16:44652) 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 -- 172.21.15.16:0/821535255 learned_addr learned my addr 172.21.15.16:0/821535255 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f199b400640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 0x7f199c134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f199be00640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f199c0c7c40 0x7f199c135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 -- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f199c0c7c40 msgr2=0x7f199c135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f199c0c7c40 0x7f199c135c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 -- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 msgr2=0x7f199c134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 0x7f199c134d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 -- 172.21.15.16:0/821535255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c136b70 con 0x7f199c0c6d00 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f199b400640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 0x7f199c134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993e00640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1984001ec0 tx=0x7f198400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840052d0 con 0x7f199c0c6d00 2024-04-25T11:05:34.866 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984005470 con 0x7f199c0c6d00 2024-04-25T11:05:34.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c1582b0 con 0x7f199c0c6d00 2024-04-25T11:05:34.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984012870 con 0x7f199c0c6d00 2024-04-25T11:05:34.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.861+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c1fddc0 con 0x7f199c0c6d00 2024-04-25T11:05:34.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199c050750 con 0x7f199c0c6d00 2024-04-25T11:05:34.867 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1984012a50 con 0x7f199c0c6d00 2024-04-25T11:05:34.868 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f1993400640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 0x7f1974071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:34.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f198408f2c0 con 0x7f199c0c6d00 2024-04-25T11:05:34.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f199b400640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 0x7f1974071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:34.869 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.865+0000 7f199b400640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 0x7f1974071ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f199c0ca640 tx=0x7f198c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:34.873 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:34.869+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f198405b710 con 0x7f199c0c6d00 2024-04-25T11:05:35.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.037+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f199c155840 con 0x7f197406f5a0 2024-04-25T11:05:35.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.037+0000 7f1993400640 1 -- 172.21.15.16:0/821535255 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f199c155840 con 0x7f197406f5a0 2024-04-25T11:05:35.041 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 msgr2=0x7f1974071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 0x7f1974071ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f199c0ca640 tx=0x7f198c0a7000 comp rx=0 tx=0).stop 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 msgr2=0x7f199c153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1984001ec0 tx=0x7f198400ca20 comp rx=0 tx=0).stop 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 shutdown_connections 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f197406f5a0 0x7f1974071ab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f199c0c7c40 0x7f199c135c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f199c0c6d00 0x7f199c153250 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 --2- 172.21.15.16:0/821535255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f199c0c68f0 0x7f199c134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 >> 172.21.15.16:0/821535255 conn(0x7f199c0cdc80 msgr2=0x7f199c1538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 shutdown_connections 2024-04-25T11:05:35.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.041+0000 7f19a2600640 1 -- 172.21.15.16:0/821535255 wait complete. 2024-04-25T11:05:35.065 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T11:05:35.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:35.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.217+0000 7f37ed800640 1 Processor -- start 2024-04-25T11:05:35.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.217+0000 7f37ed800640 1 -- start start 2024-04-25T11:05:35.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37ed800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f37e80c8af0 0x7f37e80c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37ed800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37ed800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e80c97f0 con 0x7f37e8155080 2024-04-25T11:05:35.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37ed800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f37e815e580 con 0x7f37e80c8af0 2024-04-25T11:05:35.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37ed800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f37e815e840 con 0x7f37e80ca0c0 2024-04-25T11:05:35.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37dfe00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f37e80c8af0 0x7f37e80c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:49182/0 (socket says 172.21.15.16:49182) 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 -- 172.21.15.16:0/3888861962 learned_addr learned my addr 172.21.15.16:0/3888861962 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 -- 172.21.15.16:0/3888861962 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c8af0 msgr2=0x7f37e80c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 --2- 172.21.15.16:0/3888861962 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c8af0 0x7f37e80c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 -- 172.21.15.16:0/3888861962 >> v1:172.21.15.186:6789/0 conn(0x7f37e8155080 legacy=0x7f37e80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.224 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.221+0000 7f37e7400640 1 -- 172.21.15.16:0/3888861962 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e815eb20 con 0x7f37e80ca0c0 2024-04-25T11:05:35.226 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37e7400640 1 --2- 172.21.15.16:0/3888861962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009fa0 tx=0x7f37e001caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17867bc39e352acb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37e6000640 1 -- 172.21.15.16:0/3888861962 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a5880 con 0x7f37e80ca0c0 2024-04-25T11:05:35.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37e6000640 1 -- 172.21.15.16:0/3888861962 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e00a5a20 con 0x7f37e80ca0c0 2024-04-25T11:05:35.227 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37e6000640 1 -- 172.21.15.16:0/3888861962 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e00a5e30 con 0x7f37e80ca0c0 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- 172.21.15.16:0/3888861962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 msgr2=0x7f37e80ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 --2- 172.21.15.16:0/3888861962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009fa0 tx=0x7f37e001caa0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- 172.21.15.16:0/3888861962 shutdown_connections 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 --2- 172.21.15.16:0/3888861962 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e80ca0c0 0x7f37e80ca4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 --2- 172.21.15.16:0/3888861962 >> v2:172.21.15.186:3300/0 conn(0x7f37e80c8af0 0x7f37e80c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- 172.21.15.16:0/3888861962 >> 172.21.15.16:0/3888861962 conn(0x7f37e8073140 msgr2=0x7f37e8073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- 172.21.15.16:0/3888861962 shutdown_connections 2024-04-25T11:05:35.228 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- 172.21.15.16:0/3888861962 wait complete. 2024-04-25T11:05:35.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 Processor -- start 2024-04-25T11:05:35.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.225+0000 7f37ed800640 1 -- start start 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 0x7f37e815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80ca0c0 0x7f37e8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e8155080 0x7f37e81fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f37e8155490 con 0x7f37e80c8af0 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f37e815bd90 con 0x7f37e80ca0c0 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f37e8155610 con 0x7f37e8155080 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 0x7f37e815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 0x7f37e815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44662/0 (socket says 172.21.15.16:44662) 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 -- 172.21.15.16:0/1030323599 learned_addr learned my addr 172.21.15.16:0/1030323599 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37dfe00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80ca0c0 0x7f37e8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.232 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e7400640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e8155080 0x7f37e81fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 -- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e8155080 msgr2=0x7f37e81fe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f37e8155080 0x7f37e81fe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 -- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80ca0c0 msgr2=0x7f37e8149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37e80ca0c0 0x7f37e8149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e815d330 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37e6a00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 0x7f37e815cdf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c470 tx=0x7f37d800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8017070 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d80052d0 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d80054c0 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e814a150 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e81506d0 con 0x7f37e80c8af0 2024-04-25T11:05:35.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.229+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37e815c6c0 con 0x7f37e80c8af0 2024-04-25T11:05:35.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f37d801a070 con 0x7f37e80c8af0 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5a0 0x7f37c0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f37d808e890 con 0x7f37e80c8af0 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7f37c0079040 0x7f37c007b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37c007bc40 con 0x7f37c0079040 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37d80932a0 con 0x7f37e80c8af0 2024-04-25T11:05:35.236 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dfe00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5a0 0x7f37c0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37e7400640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7f37c0079040 0x7f37c007b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dfe00640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5a0 0x7f37c0071ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37e815c650 tx=0x7f37d00091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37e7400640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7f37c0079040 0x7f37c007b530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.233+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== osd.3 v2:172.21.15.16:6824/2989148633 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37c007bc40 con 0x7f37c0079040 2024-04-25T11:05:35.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 --> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f37e8050750 con 0x7f37c0079040 2024-04-25T11:05:35.252 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37dea00640 1 -- 172.21.15.16:0/1030323599 <== osd.3 v2:172.21.15.16:6824/2989148633 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f37e8050750 con 0x7f37c0079040 2024-04-25T11:05:35.252 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:35.252 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:35.252 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7f37c0079040 msgr2=0x7f37c007b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:6824/2989148633,v1:172.21.15.16:6825/2989148633] conn(0x7f37c0079040 0x7f37c007b530 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5a0 msgr2=0x7f37c0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f37c006f5a0 0x7f37c0071ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f37e815c650 tx=0x7f37d00091c0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 msgr2=0x7f37e815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.253 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 --2- 172.21.15.16:0/1030323599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37e80c8af0 0x7f37e815cdf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f37d800c470 tx=0x7f37d800c930 comp rx=0 tx=0).stop 2024-04-25T11:05:35.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37e7400640 1 -- 172.21.15.16:0/1030323599 reap_dead start 2024-04-25T11:05:35.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 shutdown_connections 2024-04-25T11:05:35.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 >> 172.21.15.16:0/1030323599 conn(0x7f37e8073140 msgr2=0x7f37e8154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 shutdown_connections 2024-04-25T11:05:35.254 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.249+0000 7f37ed800640 1 -- 172.21.15.16:0/1030323599 wait complete. 2024-04-25T11:05:35.272 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T11:05:35.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.421+0000 7f3100400640 1 Processor -- start 2024-04-25T11:05:35.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.421+0000 7f3100400640 1 -- start start 2024-04-25T11:05:35.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f3100400640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30f8143f20 0x7f30f806c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f3100400640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80c8ce0 con 0x7f30f80c8070 2024-04-25T11:05:35.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f3100400640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80c8f50 con 0x7f30f80c56c0 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f3100400640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f30f80c9b60 con 0x7f30f8143f20 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30f8143f20 0x7f30f806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f30f8143f20 0x7f30f806c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44666/0 (socket says 172.21.15.16:44666) 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 -- 172.21.15.16:0/1225827724 learned_addr learned my addr 172.21.15.16:0/1225827724 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 -- 172.21.15.16:0/1225827724 >> v1:172.21.15.186:6789/0 conn(0x7f30f80c56c0 legacy=0x7f30f80c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 -- 172.21.15.16:0/1225827724 >> v1:172.21.15.16:6789/0 conn(0x7f30f80c8070 legacy=0x7f30f8165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.425+0000 7f30fda00640 1 -- 172.21.15.16:0/1225827724 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80c9230 con 0x7f30f8143f20 2024-04-25T11:05:35.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f30fda00640 1 --2- 172.21.15.16:0/1225827724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f806c670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0099d0 tx=0x7f30ec01ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692f464918a3603d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f30f7e00640 1 -- 172.21.15.16:0/1225827724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0b5070 con 0x7f30f8143f20 2024-04-25T11:05:35.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f30f7e00640 1 -- 172.21.15.16:0/1225827724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec0a8b70 con 0x7f30f8143f20 2024-04-25T11:05:35.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f30f7e00640 1 -- 172.21.15.16:0/1225827724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0b0440 con 0x7f30f8143f20 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- 172.21.15.16:0/1225827724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 msgr2=0x7f30f806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 --2- 172.21.15.16:0/1225827724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f806c670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0099d0 tx=0x7f30ec01ee70 comp rx=0 tx=0).stop 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- 172.21.15.16:0/1225827724 shutdown_connections 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 --2- 172.21.15.16:0/1225827724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f806c670 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- 172.21.15.16:0/1225827724 >> 172.21.15.16:0/1225827724 conn(0x7f30f8072080 msgr2=0x7f30f80724c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- 172.21.15.16:0/1225827724 shutdown_connections 2024-04-25T11:05:35.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- 172.21.15.16:0/1225827724 wait complete. 2024-04-25T11:05:35.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 Processor -- start 2024-04-25T11:05:35.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.429+0000 7f3100400640 1 -- start start 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30f80c56c0 0x7f30f813d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30f80c8070 0x7f30f813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f30f815bd40 con 0x7f30f8143f20 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80c97f0 con 0x7f30f80c8070 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f30f815bec0 con 0x7f30f80c56c0 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44672/0 (socket says 172.21.15.16:44672) 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 -- 172.21.15.16:0/1225349137 learned_addr learned my addr 172.21.15.16:0/1225349137 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fda00640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30f80c56c0 0x7f30f813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fd000640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30f80c8070 0x7f30f813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 -- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30f80c56c0 msgr2=0x7f30f813d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30f80c56c0 0x7f30f813d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 -- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30f80c8070 msgr2=0x7f30f813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30f80c8070 0x7f30f813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 -- 172.21.15.16:0/1225349137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f813d7b0 con 0x7f30f8143f20 2024-04-25T11:05:35.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30fe400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c7f0 tx=0x7f30f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0003b80 con 0x7f30f8143f20 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0003d20 con 0x7f30f8143f20 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f000aa90 con 0x7f30f8143f20 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81fc460 con 0x7f30f8143f20 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.433+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81fca20 con 0x7f30f8143f20 2024-04-25T11:05:35.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f81fc1f0 con 0x7f30f8143f20 2024-04-25T11:05:35.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30f000acf0 con 0x7f30f8143f20 2024-04-25T11:05:35.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f30f5600640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 0x7f30d4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f30f008f660 con 0x7f30f8143f20 2024-04-25T11:05:35.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f30fda00640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 0x7f30d4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.437+0000 7f30fda00640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 0x7f30d4071ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0b2000 tx=0x7f30ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.441+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30f005ba20 con 0x7f30f8143f20 2024-04-25T11:05:35.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.609+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f30f80cc890 con 0x7f30d406f5a0 2024-04-25T11:05:35.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.609+0000 7f30f5600640 1 -- 172.21.15.16:0/1225349137 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30f80cc890 con 0x7f30d406f5a0 2024-04-25T11:05:35.612 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 msgr2=0x7f30d4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 0x7f30d4071ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0b2000 tx=0x7f30ec008040 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 msgr2=0x7f30f813e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f30f000c7f0 tx=0x7f30f000ccb0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 shutdown_connections 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f30d406f5a0 0x7f30d4071ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30f8143f20 0x7f30f813e700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30f80c8070 0x7f30f813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 --2- 172.21.15.16:0/1225349137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30f80c56c0 0x7f30f813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 >> 172.21.15.16:0/1225349137 conn(0x7f30f8072080 msgr2=0x7f30f8159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 shutdown_connections 2024-04-25T11:05:35.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.613+0000 7f3100400640 1 -- 172.21.15.16:0/1225349137 wait complete. 2024-04-25T11:05:35.635 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T11:05:35.635 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:35.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 Processor -- start 2024-04-25T11:05:35.795 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 -- start start 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f446806f400 0x7f446806d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44680c96e0 con 0x7f446806e200 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f446806f0d0 con 0x7f44680c9d50 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446d800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f446806f810 con 0x7f446806f400 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446ce00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f446806e200 0x7f446806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42056/0 (socket says 172.21.15.16:42056) 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f446ce00640 1 -- 172.21.15.16:0/1820410789 learned_addr learned my addr 172.21.15.16:0/1820410789 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:35.797 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4467e00640 1 --2- 172.21.15.16:0/1820410789 >> v2:172.21.15.186:3300/0 conn(0x7f446806f400 0x7f446806d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560953318 0 0) 0x7f44680c96e0 con 0x7f446806e200 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f444c0035c0 con 0x7f446806e200 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1015884593 0 0) 0x7f444c0035c0 con 0x7f446806e200 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4467e00640 1 -- 172.21.15.16:0/1820410789 >> v1:172.21.15.186:6789/0 conn(0x7f44680c9d50 legacy=0x7f44680ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4467e00640 1 -- 172.21.15.16:0/1820410789 >> v1:172.21.15.16:6789/0 conn(0x7f446806e200 legacy=0x7f446806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.798 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.793+0000 7f4467e00640 1 -- 172.21.15.16:0/1820410789 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680c66d0 con 0x7f446806f400 2024-04-25T11:05:35.800 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f4467e00640 1 --2- 172.21.15.16:0/1820410789 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446806d780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4458009900 tx=0x7f445801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5cc3bb4ef999894 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44580b5070 con 0x7f446806f400 2024-04-25T11:05:35.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44580a8770 con 0x7f446806f400 2024-04-25T11:05:35.801 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f4466a00640 1 -- 172.21.15.16:0/1820410789 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4460001a50 con 0x7f446806f400 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 -- 172.21.15.16:0/1820410789 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 msgr2=0x7f446806d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 --2- 172.21.15.16:0/1820410789 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446806d780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4458009900 tx=0x7f445801ecb0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 -- 172.21.15.16:0/1820410789 shutdown_connections 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 --2- 172.21.15.16:0/1820410789 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446806d780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 -- 172.21.15.16:0/1820410789 >> 172.21.15.16:0/1820410789 conn(0x7f44680730a0 msgr2=0x7f44680734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 -- 172.21.15.16:0/1820410789 shutdown_connections 2024-04-25T11:05:35.802 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.797+0000 7f446d800640 1 -- 172.21.15.16:0/1820410789 wait complete. 2024-04-25T11:05:35.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 Processor -- start 2024-04-25T11:05:35.804 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 -- start start 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 0x7f44681e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446815fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44680c9d50 0x7f44681e7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f44680c6f70 con 0x7f446806e200 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f44680c6c90 con 0x7f446806f400 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446d800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f44680c7250 con 0x7f44680c9d50 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f4467e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 0x7f44681e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f4467e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 0x7f44681e9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44678/0 (socket says 172.21.15.16:44678) 2024-04-25T11:05:35.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f4467e00640 1 -- 172.21.15.16:0/463915988 learned_addr learned my addr 172.21.15.16:0/463915988 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:35.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f446ce00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44680c9d50 0x7f44681e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.807 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.801+0000 7f4467400640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446815fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 -- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44680c9d50 msgr2=0x7f44681e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f44680c9d50 0x7f44681e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 -- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 msgr2=0x7f446815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f446806f400 0x7f446815fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4468156110 con 0x7f446806e200 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f4467e00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 0x7f44681e9e50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f445801b8c0 tx=0x7f445801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44580b5040 con 0x7f446806e200 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44580a9b70 con 0x7f446806e200 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4468160ad0 con 0x7f446806e200 2024-04-25T11:05:35.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458006e60 con 0x7f446806e200 2024-04-25T11:05:35.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4468161090 con 0x7f446806e200 2024-04-25T11:05:35.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4468076da0 con 0x7f446806e200 2024-04-25T11:05:35.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.805+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f44580c2030 con 0x7f446806e200 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f444006f5a0 0x7f4440071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f445812cea0 con 0x7f446806e200 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f4440079050 0x7f444007b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f4467400640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f444006f5a0 0x7f4440071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f444007bc50 con 0x7f4440079050 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f445812d2f0 con 0x7f446806e200 2024-04-25T11:05:35.811 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f446ce00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f4440079050 0x7f444007b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:35.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f4467400640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f444006f5a0 0x7f4440071ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44681529a0 tx=0x7f4454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f446ce00640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f4440079050 0x7f444007b540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:35.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.809+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== osd.4 v2:172.21.15.186:6800/1251728210 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f444007bc50 con 0x7f4440079050 2024-04-25T11:05:35.826 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 --> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4468156690 con 0x7f4440079050 2024-04-25T11:05:35.827 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f445fe00640 1 -- 172.21.15.16:0/463915988 <== osd.4 v2:172.21.15.186:6800/1251728210 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4468156690 con 0x7f4440079050 2024-04-25T11:05:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f4440079050 msgr2=0x7f444007b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6800/1251728210,v1:172.21.15.186:6801/1251728210] conn(0x7f4440079050 0x7f444007b540 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:35.828 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f444006f5a0 msgr2=0x7f4440071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f444006f5a0 0x7f4440071ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44681529a0 tx=0x7f4454009040 comp rx=0 tx=0).stop 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 msgr2=0x7f44681e9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 --2- 172.21.15.16:0/463915988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f446806e200 0x7f44681e9e50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f445801b8c0 tx=0x7f445801ba50 comp rx=0 tx=0).stop 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446ce00640 1 -- 172.21.15.16:0/463915988 reap_dead start 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 shutdown_connections 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 >> 172.21.15.16:0/463915988 conn(0x7f44680730a0 msgr2=0x7f4468151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 shutdown_connections 2024-04-25T11:05:35.829 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:35.825+0000 7f446d800640 1 -- 172.21.15.16:0/463915988 wait complete. 2024-04-25T11:05:35.847 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T11:05:36.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 Processor -- start 2024-04-25T11:05:36.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 -- start start 2024-04-25T11:05:36.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2a006d050 0x7fb2a0165900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a015bbc0 con 0x7fb2a006e3d0 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a015be80 con 0x7fb2a006d050 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.001+0000 7fb2a7200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a00c5810 con 0x7fb2a00c82b0 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2a006d050 0x7fb2a0165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb2a006d050 0x7fb2a0165900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44690/0 (socket says 172.21.15.16:44690) 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb297e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 -- 172.21.15.16:0/1914586397 learned_addr learned my addr 172.21.15.16:0/1914586397 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb29fe00640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fb2a006e3d0 0x7fb2a00c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:40894/0 (socket says 172.21.15.16:40894) 2024-04-25T11:05:36.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 -- 172.21.15.16:0/1914586397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 msgr2=0x7fb2a006cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:36.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 --2- 172.21.15.16:0/1914586397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a006cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 -- 172.21.15.16:0/1914586397 >> v1:172.21.15.186:6789/0 conn(0x7fb2a006e3d0 legacy=0x7fb2a00c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb2a5200640 1 -- 172.21.15.16:0/1914586397 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a00c5af0 con 0x7fb2a006d050 2024-04-25T11:05:36.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.005+0000 7fb29f400640 1 -- 172.21.15.16:0/1914586397 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135530570 0 0) 0x7fb2a015bbc0 con 0x7fb2a006e3d0 2024-04-25T11:05:36.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a5200640 1 --2- 172.21.15.16:0/1914586397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006d050 0x7fb2a0165900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb298009fa0 tx=0x7fb29801cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ca476e3109baf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb29f400640 1 -- 172.21.15.16:0/1914586397 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980a5910 con 0x7fb2a006d050 2024-04-25T11:05:36.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb29f400640 1 -- 172.21.15.16:0/1914586397 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2980a5ab0 con 0x7fb2a006d050 2024-04-25T11:05:36.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb29f400640 1 -- 172.21.15.16:0/1914586397 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298007430 con 0x7fb2a006d050 2024-04-25T11:05:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 -- 172.21.15.16:0/1914586397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006d050 msgr2=0x7fb2a0165900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 --2- 172.21.15.16:0/1914586397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006d050 0x7fb2a0165900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb298009fa0 tx=0x7fb29801cb30 comp rx=0 tx=0).stop 2024-04-25T11:05:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 -- 172.21.15.16:0/1914586397 shutdown_connections 2024-04-25T11:05:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 --2- 172.21.15.16:0/1914586397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006d050 0x7fb2a0165900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 --2- 172.21.15.16:0/1914586397 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a006cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 -- 172.21.15.16:0/1914586397 >> 172.21.15.16:0/1914586397 conn(0x7fb2a0072950 msgr2=0x7fb2a00ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.009+0000 7fb2a7200640 1 -- 172.21.15.16:0/1914586397 shutdown_connections 2024-04-25T11:05:36.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.013+0000 7fb2a7200640 1 -- 172.21.15.16:0/1914586397 wait complete. 2024-04-25T11:05:36.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.013+0000 7fb2a7200640 1 Processor -- start 2024-04-25T11:05:36.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 -- start start 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2a006d050 0x7fb2a01442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00c8c60 con 0x7fb2a006e3d0 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00c6ce0 con 0x7fb2a006d050 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a7200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a006c700 con 0x7fb2a00c82b0 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb29fe00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2a006d050 0x7fb2a01442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb2a5200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44694/0 (socket says 172.21.15.16:44694) 2024-04-25T11:05:36.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 -- 172.21.15.16:0/233209933 learned_addr learned my addr 172.21.15.16:0/233209933 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 -- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 msgr2=0x7fb2a0155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a0155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 -- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2a006d050 msgr2=0x7fb2a01442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2a006d050 0x7fb2a01442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 -- 172.21.15.16:0/233209933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a0156190 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.017+0000 7fb297e00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e8e0 tx=0x7fb28800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb288017070 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28800c940 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a0157b30 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28800ccf0 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a01573e0 con 0x7fb2a006e3d0 2024-04-25T11:05:36.024 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a006ea20 con 0x7fb2a006e3d0 2024-04-25T11:05:36.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb28801a070 con 0x7fb2a006e3d0 2024-04-25T11:05:36.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 0x7fb278071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.021+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb28808f8b0 con 0x7fb2a006e3d0 2024-04-25T11:05:36.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.025+0000 7fb29fe00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 0x7fb278071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.025+0000 7fb29fe00640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 0x7fb278071ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb290001210 tx=0x7fb2900011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.033+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb28805bc70 con 0x7fb2a006e3d0 2024-04-25T11:05:36.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb2a00cc0e0 con 0x7fb27806f5a0 2024-04-25T11:05:36.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb29cc00640 1 -- 172.21.15.16:0/233209933 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2a00cc0e0 con 0x7fb27806f5a0 2024-04-25T11:05:36.203 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T11:05:36.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 msgr2=0x7fb278071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 0x7fb278071ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb290001210 tx=0x7fb2900011a0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 msgr2=0x7fb2a01fa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e8e0 tx=0x7fb28800eda0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 shutdown_connections 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb27806f5a0 0x7fb278071ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb2a00c82b0 0x7fb2a0155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb2a006e3d0 0x7fb2a01fa4f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 --2- 172.21.15.16:0/233209933 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb2a006d050 0x7fb2a01442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 >> 172.21.15.16:0/233209933 conn(0x7fb2a0072950 msgr2=0x7fb2a0159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 shutdown_connections 2024-04-25T11:05:36.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.201+0000 7fb2a7200640 1 -- 172.21.15.16:0/233209933 wait complete. 2024-04-25T11:05:36.226 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T11:05:36.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:36.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 Processor -- start 2024-04-25T11:05:36.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 -- start start 2024-04-25T11:05:36.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f05c415b980 0x7f05c4155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05c40ca850 0x7f05c40c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c415e610 con 0x7f05c40c8a90 2024-04-25T11:05:36.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f05c4155660 con 0x7f05c40ca850 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.381+0000 7f05cb000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f05c415e8b0 con 0x7f05c415b980 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c3400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f05c40c8a90 0x7f05c40ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42068/0 (socket says 172.21.15.16:42068) 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c3400640 1 -- 172.21.15.16:0/900776322 learned_addr learned my addr 172.21.15.16:0/900776322 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 --2- 172.21.15.16:0/900776322 >> v2:172.21.15.16:3300/0 conn(0x7f05c40ca850 0x7f05c40c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c3e00640 1 --2- 172.21.15.16:0/900776322 >> v2:172.21.15.186:3300/0 conn(0x7f05c415b980 0x7f05c4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 -- 172.21.15.16:0/900776322 >> v2:172.21.15.186:3300/0 conn(0x7f05c415b980 msgr2=0x7f05c4155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:36.387 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 --2- 172.21.15.16:0/900776322 >> v2:172.21.15.186:3300/0 conn(0x7f05c415b980 0x7f05c4155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 -- 172.21.15.16:0/900776322 >> v1:172.21.15.16:6789/0 conn(0x7f05c40c8a90 legacy=0x7f05c40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 -- 172.21.15.16:0/900776322 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c415eb90 con 0x7f05c40ca850 2024-04-25T11:05:36.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c9000640 1 --2- 172.21.15.16:0/900776322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c40c8ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ccd20 tx=0x7f05bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf92baa77624080 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c2a00640 1 -- 172.21.15.16:0/900776322 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0b2070 con 0x7f05c40ca850 2024-04-25T11:05:36.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c2a00640 1 -- 172.21.15.16:0/900776322 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05bc0a5900 con 0x7f05c40ca850 2024-04-25T11:05:36.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.385+0000 7f05c2a00640 1 -- 172.21.15.16:0/900776322 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a5d10 con 0x7f05c40ca850 2024-04-25T11:05:36.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- 172.21.15.16:0/900776322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 msgr2=0x7f05c40c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 --2- 172.21.15.16:0/900776322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c40c8ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ccd20 tx=0x7f05bc01ca30 comp rx=0 tx=0).stop 2024-04-25T11:05:36.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- 172.21.15.16:0/900776322 shutdown_connections 2024-04-25T11:05:36.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 --2- 172.21.15.16:0/900776322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c40c8ea0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 --2- 172.21.15.16:0/900776322 >> v2:172.21.15.186:3300/0 conn(0x7f05c415b980 0x7f05c4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- 172.21.15.16:0/900776322 >> 172.21.15.16:0/900776322 conn(0x7f05c4073160 msgr2=0x7f05c4073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- 172.21.15.16:0/900776322 shutdown_connections 2024-04-25T11:05:36.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- 172.21.15.16:0/900776322 wait complete. 2024-04-25T11:05:36.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 Processor -- start 2024-04-25T11:05:36.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.389+0000 7f05cb000640 1 -- start start 2024-04-25T11:05:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05c40c8a90 0x7f05c414c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.395 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05c415b980 0x7f05c406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40c97f0 con 0x7f05c40ca850 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40c9670 con 0x7f05c40c8a90 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f05c4167fe0 con 0x7f05c415b980 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44722/0 (socket says 172.21.15.16:44722) 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 -- 172.21.15.16:0/2288073724 learned_addr learned my addr 172.21.15.16:0/2288073724 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3e00640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05c40c8a90 0x7f05c414c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c9000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05c415b980 0x7f05c406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 -- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05c415b980 msgr2=0x7f05c406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05c415b980 0x7f05c406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 -- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05c40c8a90 msgr2=0x7f05c414c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05c40c8a90 0x7f05c414c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.396 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c415d940 con 0x7f05c40ca850 2024-04-25T11:05:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05c3400640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c415d400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05b00058d0 tx=0x7f05b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0017070 con 0x7f05c40ca850 2024-04-25T11:05:36.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0005d50 con 0x7f05c40ca850 2024-04-25T11:05:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00072b0 con 0x7f05c40ca850 2024-04-25T11:05:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c406f090 con 0x7f05c40ca850 2024-04-25T11:05:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c415cee0 con 0x7f05c40ca850 2024-04-25T11:05:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.393+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05c4050750 con 0x7f05c40ca850 2024-04-25T11:05:36.398 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f05b001a070 con 0x7f05c40ca850 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f059c06f5d0 0x7f059c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f05b008f140 con 0x7f05c40ca850 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7f059c079080 0x7f059c07b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f059c07bc80 con 0x7f059c079080 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05b008f4f0 con 0x7f05c40ca850 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05c3e00640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f059c06f5d0 0x7f059c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.400 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05c9000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7f059c079080 0x7f059c07b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05c3e00640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f059c06f5d0 0x7f059c071ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b40 tx=0x7f05b40091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.401 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.397+0000 7f05c9000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7f059c079080 0x7f059c07b570 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.402 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.401+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== osd.5 v2:172.21.15.186:6817/1601716683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f059c07bc80 con 0x7f059c079080 2024-04-25T11:05:36.416 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 --> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f05c414d4d0 con 0x7f059c079080 2024-04-25T11:05:36.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05bbe00640 1 -- 172.21.15.16:0/2288073724 <== osd.5 v2:172.21.15.186:6817/1601716683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f05c414d4d0 con 0x7f059c079080 2024-04-25T11:05:36.417 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:36.417 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:36.418 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:36.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7f059c079080 msgr2=0x7f059c07b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6817/1601716683,v1:172.21.15.186:6819/1601716683] conn(0x7f059c079080 0x7f059c07b570 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f059c06f5d0 msgr2=0x7f059c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f059c06f5d0 0x7f059c071ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b40 tx=0x7f05b40091c0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 msgr2=0x7f05c415d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 --2- 172.21.15.16:0/2288073724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05c40ca850 0x7f05c415d400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f05b00058d0 tx=0x7f05b000c910 comp rx=0 tx=0).stop 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05c9000640 1 -- 172.21.15.16:0/2288073724 reap_dead start 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 shutdown_connections 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 >> 172.21.15.16:0/2288073724 conn(0x7f05c4073160 msgr2=0x7f05c41539b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 shutdown_connections 2024-04-25T11:05:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.413+0000 7f05cb000640 1 -- 172.21.15.16:0/2288073724 wait complete. 2024-04-25T11:05:36.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T11:05:36.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 Processor -- start 2024-04-25T11:05:36.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 -- start start 2024-04-25T11:05:36.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2080c8cd0 0x7fe2080c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe20815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2080b1ed0 con 0x7fe20806c670 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fe20815b330 con 0x7fe2080c8cd0 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20f600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080b2a70 con 0x7fe2080b2660 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2080c8cd0 0x7fe2080c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20cc00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe2080c8cd0 0x7fe2080c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44724/0 (socket says 172.21.15.16:44724) 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe20cc00640 1 -- 172.21.15.16:0/155139838 learned_addr learned my addr 172.21.15.16:0/155139838 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.589+0000 7fe1ffe00640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe20815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20cc00640 1 -- 172.21.15.16:0/155139838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 msgr2=0x7fe20815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20cc00640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe20815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20cc00640 1 -- 172.21.15.16:0/155139838 >> v1:172.21.15.16:6789/0 conn(0x7fe20806c670 legacy=0x7fe20815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20cc00640 1 -- 172.21.15.16:0/155139838 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2080b0e40 con 0x7fe2080c8cd0 2024-04-25T11:05:36.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20cc00640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe2080c92a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80099d0 tx=0x7fe1f801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6407f59afe9374 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe207e00640 1 -- 172.21.15.16:0/155139838 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80ab680 con 0x7fe2080c8cd0 2024-04-25T11:05:36.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe207e00640 1 -- 172.21.15.16:0/155139838 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f80b0070 con 0x7fe2080c8cd0 2024-04-25T11:05:36.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe207e00640 1 -- 172.21.15.16:0/155139838 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80aba80 con 0x7fe2080c8cd0 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 -- 172.21.15.16:0/155139838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 msgr2=0x7fe2080c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe2080c92a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80099d0 tx=0x7fe1f801c680 comp rx=0 tx=0).stop 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 -- 172.21.15.16:0/155139838 shutdown_connections 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe20815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 --2- 172.21.15.16:0/155139838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe2080c92a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.593+0000 7fe20f600640 1 -- 172.21.15.16:0/155139838 >> 172.21.15.16:0/155139838 conn(0x7fe2080ce4a0 msgr2=0x7fe2080ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- 172.21.15.16:0/155139838 shutdown_connections 2024-04-25T11:05:36.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- 172.21.15.16:0/155139838 wait complete. 2024-04-25T11:05:36.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 Processor -- start 2024-04-25T11:05:36.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- start start 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe20806c670 0x7fe2080c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe208149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe20806ce90 con 0x7fe2080c8cd0 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2080b1a10 con 0x7fe20806c670 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.597+0000 7fe20f600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2080b3f70 con 0x7fe2080b2660 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44734/0 (socket says 172.21.15.16:44734) 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 -- 172.21.15.16:0/3267761321 learned_addr learned my addr 172.21.15.16:0/3267761321 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe1ffe00640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe208149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20cc00640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe20806c670 0x7fe2080c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 -- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 msgr2=0x7fe208149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe208149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 -- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe20806c670 msgr2=0x7fe2080c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe20806c670 0x7fe2080c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 -- 172.21.15.16:0/3267761321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe208149fe0 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20d600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c7e0 tx=0x7fe20000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200016020 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200006d80 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe208159400 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200003bc0 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2081faa60 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe208050750 con 0x7fe2080c8cd0 2024-04-25T11:05:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.601+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe20000a850 con 0x7fe2080c8cd0 2024-04-25T11:05:36.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.605+0000 7fe205600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 0x7fe1e0071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.605+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe20008f260 con 0x7fe2080c8cd0 2024-04-25T11:05:36.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.605+0000 7fe20cc00640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 0x7fe1e0071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.605+0000 7fe20cc00640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 0x7fe1e0071ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80af000 tx=0x7fe1f80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.609+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe200020020 con 0x7fe2080c8cd0 2024-04-25T11:05:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fe20815a600 con 0x7fe1e006f5a0 2024-04-25T11:05:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe205600640 1 -- 172.21.15.16:0/3267761321 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe20815a600 con 0x7fe1e006f5a0 2024-04-25T11:05:36.784 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T11:05:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 msgr2=0x7fe1e0071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 0x7fe1e0071ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe1f80af000 tx=0x7fe1f80a7000 comp rx=0 tx=0).stop 2024-04-25T11:05:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 msgr2=0x7fe20814b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe20000c7e0 tx=0x7fe20000cca0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 shutdown_connections 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe1e006f5a0 0x7fe1e0071ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2080c8cd0 0x7fe20814b910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2080b2660 0x7fe208149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 --2- 172.21.15.16:0/3267761321 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe20806c670 0x7fe2080c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 >> 172.21.15.16:0/3267761321 conn(0x7fe2080ce4a0 msgr2=0x7fe2080cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 shutdown_connections 2024-04-25T11:05:36.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.781+0000 7fe20f600640 1 -- 172.21.15.16:0/3267761321 wait complete. 2024-04-25T11:05:36.808 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T11:05:36.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:36.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.969+0000 7f12dac00640 1 Processor -- start 2024-04-25T11:05:36.973 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.969+0000 7f12dac00640 1 -- start start 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12dac00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f12d40c8af0 0x7f12d40c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12dac00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12d40ca0c0 0x7f12d40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12dac00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d40c97f0 con 0x7f12d4155080 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12dac00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f12d415e580 con 0x7f12d40ca0c0 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12dac00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f12d415e840 con 0x7f12d40c8af0 2024-04-25T11:05:36.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12d40ca0c0 0x7f12d40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12d40ca0c0 0x7f12d40ca4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44738/0 (socket says 172.21.15.16:44738) 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 -- 172.21.15.16:0/3844466055 learned_addr learned my addr 172.21.15.16:0/3844466055 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12cbe00640 1 --2- 172.21.15.16:0/3844466055 >> v2:172.21.15.186:3300/0 conn(0x7f12d40c8af0 0x7f12d40c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 -- 172.21.15.16:0/3844466055 >> v2:172.21.15.186:3300/0 conn(0x7f12d40c8af0 msgr2=0x7f12d40c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 --2- 172.21.15.16:0/3844466055 >> v2:172.21.15.186:3300/0 conn(0x7f12d40c8af0 0x7f12d40c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 -- 172.21.15.16:0/3844466055 >> v1:172.21.15.16:6789/0 conn(0x7f12d4155080 legacy=0x7f12d40c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.977 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.973+0000 7f12d8c00640 1 -- 172.21.15.16:0/3844466055 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d415eb20 con 0x7f12d40ca0c0 2024-04-25T11:05:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12d8c00640 1 --2- 172.21.15.16:0/3844466055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d40ca4d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f12d4158b20 tx=0x7f12cc01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298cd32112bf9875 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12d3400640 1 -- 172.21.15.16:0/3844466055 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0a5840 con 0x7f12d40ca0c0 2024-04-25T11:05:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12d3400640 1 -- 172.21.15.16:0/3844466055 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc0a59e0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12d3400640 1 -- 172.21.15.16:0/3844466055 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0a5df0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 -- 172.21.15.16:0/3844466055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 msgr2=0x7f12d40ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 --2- 172.21.15.16:0/3844466055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d40ca4d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f12d4158b20 tx=0x7f12cc01ca60 comp rx=0 tx=0).stop 2024-04-25T11:05:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 -- 172.21.15.16:0/3844466055 shutdown_connections 2024-04-25T11:05:36.980 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 --2- 172.21.15.16:0/3844466055 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d40ca4d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 --2- 172.21.15.16:0/3844466055 >> v2:172.21.15.186:3300/0 conn(0x7f12d40c8af0 0x7f12d40c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 -- 172.21.15.16:0/3844466055 >> 172.21.15.16:0/3844466055 conn(0x7f12d4073140 msgr2=0x7f12d4073550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 -- 172.21.15.16:0/3844466055 shutdown_connections 2024-04-25T11:05:36.981 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.977+0000 7f12dac00640 1 -- 172.21.15.16:0/3844466055 wait complete. 2024-04-25T11:05:36.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 Processor -- start 2024-04-25T11:05:36.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- start start 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12d40c8af0 0x7f12d414b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d41fc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12d4155080 0x7f12d41fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4155490 con 0x7f12d40ca0c0 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f12d415bd90 con 0x7f12d40c8af0 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f12d4155610 con 0x7f12d4155080 2024-04-25T11:05:36.985 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d41fc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12d3e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12d40c8af0 0x7f12d414b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d41fc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44748/0 (socket says 172.21.15.16:44748) 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 -- 172.21.15.16:0/4009150273 learned_addr learned my addr 172.21.15.16:0/4009150273 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12d8c00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12d4155080 0x7f12d41fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 -- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12d4155080 msgr2=0x7f12d41fcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f12d4155080 0x7f12d41fcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 -- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12d40c8af0 msgr2=0x7f12d414b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12d40c8af0 0x7f12d414b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d414b970 con 0x7f12d40ca0c0 2024-04-25T11:05:36.986 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12cbe00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d41fc6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00d800 tx=0x7f12bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00b6c0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12bc019070 con 0x7f12d40ca0c0 2024-04-25T11:05:36.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d4156710 con 0x7f12d40ca0c0 2024-04-25T11:05:36.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00bac0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.987 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.981+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d40ce5e0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12d4050750 con 0x7f12d40ca0c0 2024-04-25T11:05:36.988 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f12bc00bc60 con 0x7f12d40ca0c0 2024-04-25T11:05:36.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f12ac06f5a0 0x7f12ac071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f12bc08fb30 con 0x7f12d40ca0c0 2024-04-25T11:05:36.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7f12ac079040 0x7f12ac07b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:36.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12bc013e50 con 0x7f12ac079040 2024-04-25T11:05:36.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f12bc0942a0 con 0x7f12d40ca0c0 2024-04-25T11:05:36.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d3e00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f12ac06f5a0 0x7f12ac071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d8c00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7f12ac079040 0x7f12ac07b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:36.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.985+0000 7f12d3e00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f12ac06f5a0 0x7f12ac071ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12d4072cc0 tx=0x7f12c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.990 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.989+0000 7f12d8c00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7f12ac079040 0x7f12ac07b530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:36.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:36.989+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== osd.6 v2:172.21.15.186:6808/1602964832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12bc013e50 con 0x7f12ac079040 2024-04-25T11:05:37.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.001+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 --> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f12d40c8700 con 0x7f12ac079040 2024-04-25T11:05:37.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12d0c00640 1 -- 172.21.15.16:0/4009150273 <== osd.6 v2:172.21.15.186:6808/1602964832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f12d40c8700 con 0x7f12ac079040 2024-04-25T11:05:37.007 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:37.007 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:37.007 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7f12ac079040 msgr2=0x7f12ac07b530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6808/1602964832,v1:172.21.15.186:6809/1602964832] conn(0x7f12ac079040 0x7f12ac07b530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f12ac06f5a0 msgr2=0x7f12ac071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f12ac06f5a0 0x7f12ac071ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12d4072cc0 tx=0x7f12c4009040 comp rx=0 tx=0).stop 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 msgr2=0x7f12d41fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 --2- 172.21.15.16:0/4009150273 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12d40ca0c0 0x7f12d41fc6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00d800 tx=0x7f12bc00dcc0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12d8c00640 1 -- 172.21.15.16:0/4009150273 reap_dead start 2024-04-25T11:05:37.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 shutdown_connections 2024-04-25T11:05:37.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 >> 172.21.15.16:0/4009150273 conn(0x7f12d4073140 msgr2=0x7f12d415a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 shutdown_connections 2024-04-25T11:05:37.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.005+0000 7f12dac00640 1 -- 172.21.15.16:0/4009150273 wait complete. 2024-04-25T11:05:37.026 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T11:05:37.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 Processor -- start 2024-04-25T11:05:37.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 -- start start 2024-04-25T11:05:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 0x7feca406d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feca406dbc0 0x7feca4159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feca40c4b40 con 0x7feca4159a70 2024-04-25T11:05:37.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7feca406c670 con 0x7feca406dbc0 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.177+0000 7feca9a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feca40c51e0 con 0x7feca40c9f70 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca3400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feca4159a70 0x7feca4159e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42104/0 (socket says 172.21.15.16:42104) 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca3400640 1 -- 172.21.15.16:0/302826060 learned_addr learned my addr 172.21.15.16:0/302826060 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 --2- 172.21.15.16:0/302826060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 0x7feca406d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7fec9be00640 1 --2- 172.21.15.16:0/302826060 >> v2:172.21.15.186:3300/0 conn(0x7feca406dbc0 0x7feca4159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930059062 0 0) 0x7feca40c4b40 con 0x7feca4159a70 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec880035c0 con 0x7feca4159a70 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 -- 172.21.15.16:0/302826060 >> v2:172.21.15.186:3300/0 conn(0x7feca406dbc0 msgr2=0x7feca4159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:37.184 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 --2- 172.21.15.16:0/302826060 >> v2:172.21.15.186:3300/0 conn(0x7feca406dbc0 0x7feca4159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 -- 172.21.15.16:0/302826060 >> v1:172.21.15.16:6789/0 conn(0x7feca4159a70 legacy=0x7feca4159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3900369709 0 0) 0x7fec880035c0 con 0x7feca4159a70 2024-04-25T11:05:37.185 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 -- 172.21.15.16:0/302826060 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca406c8c0 con 0x7feca40c9f70 2024-04-25T11:05:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.181+0000 7feca2a00640 1 --2- 172.21.15.16:0/302826060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 0x7feca406d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec94009900 tx=0x7fec9401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c79927f711cfccf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940b5070 con 0x7feca40c9f70 2024-04-25T11:05:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec940a8730 con 0x7feca40c9f70 2024-04-25T11:05:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca2000640 1 -- 172.21.15.16:0/302826060 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c001a00 con 0x7feca40c9f70 2024-04-25T11:05:37.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- 172.21.15.16:0/302826060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 msgr2=0x7feca406d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 --2- 172.21.15.16:0/302826060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 0x7feca406d680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fec94009900 tx=0x7fec9401ecb0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- 172.21.15.16:0/302826060 shutdown_connections 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 --2- 172.21.15.16:0/302826060 >> v2:172.21.15.186:3300/0 conn(0x7feca406dbc0 0x7feca4159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 --2- 172.21.15.16:0/302826060 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca40c9f70 0x7feca406d680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- 172.21.15.16:0/302826060 >> 172.21.15.16:0/302826060 conn(0x7feca40ca680 msgr2=0x7feca40caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- 172.21.15.16:0/302826060 shutdown_connections 2024-04-25T11:05:37.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- 172.21.15.16:0/302826060 wait complete. 2024-04-25T11:05:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 Processor -- start 2024-04-25T11:05:37.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.185+0000 7feca9a00640 1 -- start start 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feca406dbc0 0x7feca414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 0x7feca4155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7feca406d160 con 0x7feca40c9f70 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feca406ce80 con 0x7feca406dbc0 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feca40c4e30 con 0x7feca4159a70 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.193 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44764/0 (socket says 172.21.15.16:44764) 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 -- 172.21.15.16:0/266592530 learned_addr learned my addr 172.21.15.16:0/266592530 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca2a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feca406dbc0 0x7feca414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca3400640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 0x7feca4155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 -- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 msgr2=0x7feca4155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 0x7feca4155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 -- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feca406dbc0 msgr2=0x7feca414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feca406dbc0 0x7feca414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 -- 172.21.15.16:0/266592530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41555c0 con 0x7feca40c9f70 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca3400640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 0x7feca4155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:37.194 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9be00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00e910 tx=0x7fec8c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c016070 con 0x7feca40c9f70 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c00cc40 con 0x7feca40c9f70 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00b040 con 0x7feca40c9f70 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca414c4a0 con 0x7feca40c9f70 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41f4760 con 0x7feca40c9f70 2024-04-25T11:05:37.195 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.189+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca4050750 con 0x7feca40c9f70 2024-04-25T11:05:37.196 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.193+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fec8c019070 con 0x7feca40c9f70 2024-04-25T11:05:37.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.193+0000 7fec9aa00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 0x7fec7c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.193+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fec8c08f240 con 0x7feca40c9f70 2024-04-25T11:05:37.197 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.193+0000 7feca2a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 0x7fec7c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.198 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.193+0000 7feca2a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 0x7fec7c071ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec940b2000 tx=0x7fec94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.197+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec8c05b6f0 con 0x7feca40c9f70 2024-04-25T11:05:37.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.373+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7feca40cbff0 con 0x7fec7c06f5a0 2024-04-25T11:05:37.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.373+0000 7fec9aa00640 1 -- 172.21.15.16:0/266592530 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fec940a8a30 con 0x7fec7c06f5a0 2024-04-25T11:05:37.377 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T11:05:37.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 msgr2=0x7fec7c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 0x7fec7c071ab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fec940b2000 tx=0x7fec94008040 comp rx=0 tx=0).stop 2024-04-25T11:05:37.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 msgr2=0x7feca414ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00e910 tx=0x7fec8c00edd0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 shutdown_connections 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fec7c06f5a0 0x7fec7c071ab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feca4159a70 0x7feca4155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feca40c9f70 0x7feca414ddf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 --2- 172.21.15.16:0/266592530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feca406dbc0 0x7feca414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 >> 172.21.15.16:0/266592530 conn(0x7feca40ca680 msgr2=0x7feca40c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 shutdown_connections 2024-04-25T11:05:37.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.377+0000 7feca9a00640 1 -- 172.21.15.16:0/266592530 wait complete. 2024-04-25T11:05:37.399 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T11:05:37.400 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T11:05:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 Processor -- start 2024-04-25T11:05:37.555 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 -- start start 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6a500cae10 0x7f6a500cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a500c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a500c9d30 con 0x7f6a5015a850 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5015d3c0 con 0x7f6a500cae10 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a55e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5015df40 con 0x7f6a500c35c0 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4ea00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6a5015a850 0x7f6a500c9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42114/0 (socket says 172.21.15.16:42114) 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4ea00640 1 -- 172.21.15.16:0/3060997420 learned_addr learned my addr 172.21.15.16:0/3060997420 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4f400640 1 --2- 172.21.15.16:0/3060997420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a500c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a47e00640 1 --2- 172.21.15.16:0/3060997420 >> v2:172.21.15.186:3300/0 conn(0x7f6a500cae10 0x7f6a500cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.558 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748020280 0 0) 0x7f6a500c9d30 con 0x7f6a5015a850 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a340035c0 con 0x7f6a5015a850 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4f400640 1 -- 172.21.15.16:0/3060997420 >> v2:172.21.15.186:3300/0 conn(0x7f6a500cae10 msgr2=0x7f6a500cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4f400640 1 --2- 172.21.15.16:0/3060997420 >> v2:172.21.15.186:3300/0 conn(0x7f6a500cae10 0x7f6a500cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4f400640 1 -- 172.21.15.16:0/3060997420 >> v1:172.21.15.16:6789/0 conn(0x7f6a5015a850 legacy=0x7f6a500c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3879506983 0 0) 0x7f6a340035c0 con 0x7f6a5015a850 2024-04-25T11:05:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.553+0000 7f6a4f400640 1 -- 172.21.15.16:0/3060997420 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5015d610 con 0x7f6a500c35c0 2024-04-25T11:05:37.561 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a4f400640 1 --2- 172.21.15.16:0/3060997420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a500c39d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a5015d540 tx=0x7f6a4801ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=150537afbf0558e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480b2070 con 0x7f6a500c35c0 2024-04-25T11:05:37.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a480a5920 con 0x7f6a500c35c0 2024-04-25T11:05:37.562 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a4e000640 1 -- 172.21.15.16:0/3060997420 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a5cd0 con 0x7f6a500c35c0 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a55e00640 1 -- 172.21.15.16:0/3060997420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 msgr2=0x7f6a500c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.557+0000 7f6a55e00640 1 --2- 172.21.15.16:0/3060997420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a500c39d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6a5015d540 tx=0x7f6a4801ca50 comp rx=0 tx=0).stop 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- 172.21.15.16:0/3060997420 shutdown_connections 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 --2- 172.21.15.16:0/3060997420 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a500c39d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 --2- 172.21.15.16:0/3060997420 >> v2:172.21.15.186:3300/0 conn(0x7f6a500cae10 0x7f6a500cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- 172.21.15.16:0/3060997420 >> 172.21.15.16:0/3060997420 conn(0x7f6a500720f0 msgr2=0x7f6a500725e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- 172.21.15.16:0/3060997420 shutdown_connections 2024-04-25T11:05:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- 172.21.15.16:0/3060997420 wait complete. 2024-04-25T11:05:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 Processor -- start 2024-04-25T11:05:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- start start 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a5013f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a500cae10 0x7f6a501585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 0x7f6a50158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5006c670 con 0x7f6a5015a850 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.561+0000 7f6a55e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5015ac60 con 0x7f6a500cae10 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a55e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5006c7f0 con 0x7f6a500c35c0 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 0x7f6a50158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 0x7f6a50158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44778/0 (socket says 172.21.15.16:44778) 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 -- 172.21.15.16:0/1247421181 learned_addr learned my addr 172.21.15.16:0/1247421181 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4ea00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a5013f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a500cae10 0x7f6a501585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 -- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 msgr2=0x7f6a5013f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a5013f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 -- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a500cae10 msgr2=0x7f6a501585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a500cae10 0x7f6a501585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a501f75f0 con 0x7f6a5015a850 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a500cae10 0x7f6a501585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4ea00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a500c35c0 0x7f6a5013f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a4f400640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 0x7f6a50158b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a480b0040 tx=0x7f6a480197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480b2050 con 0x7f6a5015a850 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a480be070 con 0x7f6a5015a850 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480ada50 con 0x7f6a5015a850 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a501594f0 con 0x7f6a5015a850 2024-04-25T11:05:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501f7b90 con 0x7f6a5015a850 2024-04-25T11:05:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a50050750 con 0x7f6a5015a850 2024-04-25T11:05:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.565+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6a480adc30 con 0x7f6a5015a850 2024-04-25T11:05:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47400640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6a2806f5a0 0x7f6a28071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f6a4812a890 con 0x7f6a5015a850 2024-04-25T11:05:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47400640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7f6a28079050 0x7f6a2807b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a480bce80 con 0x7f6a28079050 2024-04-25T11:05:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a4812f2a0 con 0x7f6a5015a850 2024-04-25T11:05:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a4ea00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6a2806f5a0 0x7f6a28071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7f6a28079050 0x7f6a2807b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a4ea00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6a2806f5a0 0x7f6a28071ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a40001240 tx=0x7f6a40006870 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.569+0000 7f6a47e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7f6a28079050 0x7f6a2807b540 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.574 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.573+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== osd.7 v2:172.21.15.186:6816/3819886941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a480bce80 con 0x7f6a28079050 2024-04-25T11:05:37.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 --> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6a50144400 con 0x7f6a28079050 2024-04-25T11:05:37.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a47400640 1 -- 172.21.15.16:0/1247421181 <== osd.7 v2:172.21.15.186:6816/3819886941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6a50144400 con 0x7f6a28079050 2024-04-25T11:05:37.589 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-25T11:05:37.589 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T11:05:37.589 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7f6a28079050 msgr2=0x7f6a2807b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6816/3819886941,v1:172.21.15.186:6818/3819886941] conn(0x7f6a28079050 0x7f6a2807b540 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6a2806f5a0 msgr2=0x7f6a28071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f6a2806f5a0 0x7f6a28071ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a40001240 tx=0x7f6a40006870 comp rx=0 tx=0).stop 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 msgr2=0x7f6a50158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 --2- 172.21.15.16:0/1247421181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a5015a850 0x7f6a50158b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6a480b0040 tx=0x7f6a480197f0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a4f400640 1 -- 172.21.15.16:0/1247421181 reap_dead start 2024-04-25T11:05:37.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 shutdown_connections 2024-04-25T11:05:37.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 >> 172.21.15.16:0/1247421181 conn(0x7f6a500720f0 msgr2=0x7f6a501526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 shutdown_connections 2024-04-25T11:05:37.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.585+0000 7f6a55e00640 1 -- 172.21.15.16:0/1247421181 wait complete. 2024-04-25T11:05:37.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T11:05:37.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.757+0000 7fb95c000640 1 Processor -- start 2024-04-25T11:05:37.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.757+0000 7fb95c000640 1 -- start start 2024-04-25T11:05:37.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95c000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95c000640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb954162620 0x7fb954164a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95c000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540705c0 con 0x7fb9540ca730 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95c000640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540c41d0 con 0x7fb954162620 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95c000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb954070880 con 0x7fb9540c49b0 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.16:49292/0 (socket says 172.21.15.16:49292) 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 -- 172.21.15.16:0/1423479823 learned_addr learned my addr 172.21.15.16:0/1423479823 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb95a000640 1 --2- 172.21.15.16:0/1423479823 >> v2:172.21.15.186:3300/0 conn(0x7fb954162620 0x7fb954164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 -- 172.21.15.16:0/1423479823 >> v2:172.21.15.186:3300/0 conn(0x7fb954162620 msgr2=0x7fb954164a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 --2- 172.21.15.16:0/1423479823 >> v2:172.21.15.186:3300/0 conn(0x7fb954162620 0x7fb954164a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 -- 172.21.15.16:0/1423479823 >> v1:172.21.15.186:6789/0 conn(0x7fb9540ca730 legacy=0x7fb9540b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.765 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.761+0000 7fb958c00640 1 -- 172.21.15.16:0/1423479823 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb954070b60 con 0x7fb9540c49b0 2024-04-25T11:05:37.766 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb958c00640 1 --2- 172.21.15.16:0/1423479823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb94000bc70 tx=0x7fb94001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27321bc178b0b5f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb953e00640 1 -- 172.21.15.16:0/1423479823 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400b4070 con 0x7fb9540c49b0 2024-04-25T11:05:37.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb953e00640 1 -- 172.21.15.16:0/1423479823 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9400a7d40 con 0x7fb9540c49b0 2024-04-25T11:05:37.767 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb953e00640 1 -- 172.21.15.16:0/1423479823 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9400af660 con 0x7fb9540c49b0 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 -- 172.21.15.16:0/1423479823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 msgr2=0x7fb954159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 --2- 172.21.15.16:0/1423479823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb94000bc70 tx=0x7fb94001ed50 comp rx=0 tx=0).stop 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 -- 172.21.15.16:0/1423479823 shutdown_connections 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 --2- 172.21.15.16:0/1423479823 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9540c49b0 0x7fb954159cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 --2- 172.21.15.16:0/1423479823 >> v2:172.21.15.186:3300/0 conn(0x7fb954162620 0x7fb954164a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 -- 172.21.15.16:0/1423479823 >> 172.21.15.16:0/1423479823 conn(0x7fb9540ce950 msgr2=0x7fb9540cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 -- 172.21.15.16:0/1423479823 shutdown_connections 2024-04-25T11:05:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 -- 172.21.15.16:0/1423479823 wait complete. 2024-04-25T11:05:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.765+0000 7fb95c000640 1 Processor -- start 2024-04-25T11:05:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- start start 2024-04-25T11:05:37.772 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9540ca730 0x7fb954154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb954162620 0x7fb954162ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540b2940 con 0x7fb9540c49b0 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540b27c0 con 0x7fb9540ca730 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540c3c20 con 0x7fb954162620 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44782/0 (socket says 172.21.15.16:44782) 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 -- 172.21.15.16:0/14617099 learned_addr learned my addr 172.21.15.16:0/14617099 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb958c00640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9540ca730 0x7fb954154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95a000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb954162620 0x7fb954162ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 -- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb954162620 msgr2=0x7fb954162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb954162620 0x7fb954162ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 -- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9540ca730 msgr2=0x7fb954154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9540ca730 0x7fb954154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.774 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 -- 172.21.15.16:0/14617099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9541631e0 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb959600640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c4f0 tx=0x7fb94800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948016020 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9480052d0 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb954164670 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948007240 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541fbe00 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.769+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb954050750 con 0x7fb9540c49b0 2024-04-25T11:05:37.775 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.773+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb948007460 con 0x7fb9540c49b0 2024-04-25T11:05:37.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.773+0000 7fb951600640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 0x7fb930071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:37.776 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.773+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb94808ef10 con 0x7fb9540c49b0 2024-04-25T11:05:37.777 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.773+0000 7fb958c00640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 0x7fb930071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:37.778 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.773+0000 7fb958c00640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 0x7fb930071ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9400b1000 tx=0x7fb940008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:37.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.777+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb948020020 con 0x7fb9540c49b0 2024-04-25T11:05:37.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.969+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb9541633b0 con 0x7fb93006f5d0 2024-04-25T11:05:37.972 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.969+0000 7fb951600640 1 -- 172.21.15.16:0/14617099 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb9541633b0 con 0x7fb93006f5d0 2024-04-25T11:05:37.973 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 msgr2=0x7fb930071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 0x7fb930071ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9400b1000 tx=0x7fb940008040 comp rx=0 tx=0).stop 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 msgr2=0x7fb9541648e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c4f0 tx=0x7fb94800c9b0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 shutdown_connections 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fb93006f5d0 0x7fb930071ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb954162620 0x7fb954162ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9540ca730 0x7fb954154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 --2- 172.21.15.16:0/14617099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9540c49b0 0x7fb9541648e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:37.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 >> 172.21.15.16:0/14617099 conn(0x7fb9540ce950 msgr2=0x7fb9540c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:37.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 shutdown_connections 2024-04-25T11:05:37.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:37.973+0000 7fb95c000640 1 -- 172.21.15.16:0/14617099 wait complete. 2024-04-25T11:05:37.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:05:38.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.161+0000 7f142a800640 1 Processor -- start 2024-04-25T11:05:38.165 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.161+0000 7f142a800640 1 -- start start 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f142a800640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14240cc4d0 0x7f1424154e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f142a800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f14241553c0 0x7f142415b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f142a800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240cbc40 con 0x7f14240cc0c0 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f142a800640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f142415f4a0 con 0x7f14240cc4d0 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f142a800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f14240c6ed0 con 0x7f14241553c0 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14240cc4d0 0x7f1424154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f1423400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f14240cc0c0 0x7f14240c67c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:42126/0 (socket says 172.21.15.16:42126) 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f14240cc4d0 0x7f1424154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44796/0 (socket says 172.21.15.16:44796) 2024-04-25T11:05:38.167 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f1423400640 1 -- 172.21.15.16:0/1983088587 learned_addr learned my addr 172.21.15.16:0/1983088587 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:38.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f1423e00640 1 --2- 172.21.15.16:0/1983088587 >> v2:172.21.15.186:3300/0 conn(0x7f14241553c0 0x7f142415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 -- 172.21.15.16:0/1983088587 >> v2:172.21.15.186:3300/0 conn(0x7f14241553c0 msgr2=0x7f142415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:38.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 --2- 172.21.15.16:0/1983088587 >> v2:172.21.15.186:3300/0 conn(0x7f14241553c0 0x7f142415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 -- 172.21.15.16:0/1983088587 >> v1:172.21.15.16:6789/0 conn(0x7f14240cc0c0 legacy=0x7f14240c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.168 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.165+0000 7f141be00640 1 -- 172.21.15.16:0/1983088587 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142415e5b0 con 0x7f14240cc4d0 2024-04-25T11:05:38.170 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f141be00640 1 --2- 172.21.15.16:0/1983088587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc4d0 0x7f1424154e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f14240ccc40 tx=0x7f140c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe1b19bad23ad8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:38.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f1422a00640 1 -- 172.21.15.16:0/1983088587 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0b5070 con 0x7f14240cc4d0 2024-04-25T11:05:38.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f1422a00640 1 -- 172.21.15.16:0/1983088587 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c0a8a70 con 0x7f14240cc4d0 2024-04-25T11:05:38.171 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f1422a00640 1 -- 172.21.15.16:0/1983088587 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0b0440 con 0x7f14240cc4d0 2024-04-25T11:05:38.172 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 -- 172.21.15.16:0/1983088587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc4d0 msgr2=0x7f1424154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 --2- 172.21.15.16:0/1983088587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc4d0 0x7f1424154e80 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f14240ccc40 tx=0x7f140c01ed70 comp rx=0 tx=0).stop 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 -- 172.21.15.16:0/1983088587 shutdown_connections 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 --2- 172.21.15.16:0/1983088587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc4d0 0x7f1424154e80 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 --2- 172.21.15.16:0/1983088587 >> v2:172.21.15.186:3300/0 conn(0x7f14241553c0 0x7f142415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 -- 172.21.15.16:0/1983088587 >> 172.21.15.16:0/1983088587 conn(0x7f14240730f0 msgr2=0x7f14240735e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 -- 172.21.15.16:0/1983088587 shutdown_connections 2024-04-25T11:05:38.173 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.169+0000 7f142a800640 1 -- 172.21.15.16:0/1983088587 wait complete. 2024-04-25T11:05:38.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 Processor -- start 2024-04-25T11:05:38.175 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 -- start start 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14240cc4d0 0x7f14241e9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 0x7f1424156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f142415ee50 con 0x7f14240cc0c0 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f142415eb70 con 0x7f14241553c0 2024-04-25T11:05:38.178 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f142415f130 con 0x7f14240cc4d0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:44804/0 (socket says 172.21.15.16:44804) 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 -- 172.21.15.16:0/3027457251 learned_addr learned my addr 172.21.15.16:0/3027457251 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f141be00640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14240cc4d0 0x7f14241e9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423e00640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 0x7f1424156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 -- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14240cc4d0 msgr2=0x7f14241e9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14240cc4d0 0x7f14241e9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 -- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 msgr2=0x7f1424156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 0x7f1424156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 -- 172.21.15.16:0/3027457251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14241e8d70 con 0x7f14240cc0c0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423e00640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 0x7f1424156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f1423400640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f141400c4e0 tx=0x7f141400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414017070 con 0x7f14240cc0c0 2024-04-25T11:05:38.179 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1414005d30 con 0x7f14240cc0c0 2024-04-25T11:05:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14241ea120 con 0x7f14240cc0c0 2024-04-25T11:05:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.173+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14140072b0 con 0x7f14240cc0c0 2024-04-25T11:05:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.177+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14241f71c0 con 0x7f14240cc0c0 2024-04-25T11:05:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.177+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1424050750 con 0x7f14240cc0c0 2024-04-25T11:05:38.180 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.177+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f141401a070 con 0x7f14240cc0c0 2024-04-25T11:05:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.177+0000 7f141b400640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 0x7f13fc071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.177+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f141408ea70 con 0x7f14240cc0c0 2024-04-25T11:05:38.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.181+0000 7f141be00640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 0x7f13fc071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:38.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.181+0000 7f141be00640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 0x7f13fc071ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b2000 tx=0x7f140c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:38.187 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.185+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14241e8d70 con 0x7f14240cc0c0 2024-04-25T11:05:38.360 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.357+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1424070180 con 0x7f13fc06f5a0 2024-04-25T11:05:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.381+0000 7f141b400640 1 -- 172.21.15.16:0/3027457251 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334390 (secure 0 0 0) 0x7f1424070180 con 0x7f13fc06f5a0 2024-04-25T11:05:38.388 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 msgr2=0x7f13fc071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 0x7f13fc071ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f140c0b2000 tx=0x7f140c009040 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 msgr2=0x7f142415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f141400c4e0 tx=0x7f141400c9a0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 shutdown_connections 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f13fc06f5a0 0x7f13fc071ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14241553c0 0x7f1424156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f14240cc4d0 0x7f14241e9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 --2- 172.21.15.16:0/3027457251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14240cc0c0 0x7f142415a9a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 >> 172.21.15.16:0/3027457251 conn(0x7f14240730f0 msgr2=0x7f14241527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 shutdown_connections 2024-04-25T11:05:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:38.385+0000 7f142a800640 1 -- 172.21.15.16:0/3027457251 wait complete. 2024-04-25T11:05:38.410 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":828,"stamp":"2024-04-25T11:05:38.359189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":242979483,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":7933,"num_read_kb":1313356,"num_write":299481,"num_write_kb":5299792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477746,"ondisk_log_size":477746,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5779552,"kb_used_data":300000,"kb_used_omap":12,"kb_used_meta":5479475,"kb_avail":749195168,"statfs":{"total":773094113280,"available":767175852032,"internally_reserved":0,"allocated":307200000,"data_stored":486968382,"data_compressed":55878340,"data_compressed_allocated":82345984,"data_compressed_original":263692288,"omap_allocated":12751,"internal_metadata":5610982961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-128659742,"num_objects":-714,"num_object_clones":0,"num_object_copies":-2188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-714,"num_whiteouts":0,"num_read":13,"num_read_kb":107,"num_write":1111,"num_write_kb":16580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-95,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006186"},"pg_stats":[{"pgid":"2.1f","version":"28'1887","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.708782+0000","last_change":"2024-04-25T11:05:36.708842+0000","last_active":"2024-04-25T11:05:36.708782+0000","last_peered":"2024-04-25T11:05:36.708782+0000","last_clean":"2024-04-25T11:05:36.708782+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:05:36.708782+0000","last_undegraded":"2024-04-25T11:05:36.708782+0000","last_fullsized":"2024-04-25T11:05:36.708782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1887","last_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_deep_scrub":"28'1887","last_deep_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.708689+0000","objects_scrubbed":4,"log_size":1887,"log_dups_size":0,"ondisk_log_size":1887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.316407+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1897,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1897","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.979434+0000","last_change":"2024-04-25T10:38:59.343215+0000","last_active":"2024-04-25T11:05:30.979434+0000","last_peered":"2024-04-25T11:05:30.979434+0000","last_clean":"2024-04-25T11:05:30.979434+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:30.979434+0000","last_undegraded":"2024-04-25T11:05:30.979434+0000","last_fullsized":"2024-04-25T11:05:30.979434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6392","reported_seq":6465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.096103+0000","last_change":"2024-04-25T10:39:04.077805+0000","last_active":"2024-04-25T11:05:31.096103+0000","last_peered":"2024-04-25T11:05:31.096103+0000","last_clean":"2024-04-25T11:05:31.096103+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:31.096103+0000","last_undegraded":"2024-04-25T11:05:31.096103+0000","last_fullsized":"2024-04-25T11:05:31.096103+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6292,"log_dups_size":0,"ondisk_log_size":6292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:45.818023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4427,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4891","reported_seq":4931,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.612083+0000","last_change":"2024-04-25T10:38:58.341270+0000","last_active":"2024-04-25T11:05:27.612083+0000","last_peered":"2024-04-25T11:05:27.612083+0000","last_clean":"2024-04-25T11:05:27.612083+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:27.612083+0000","last_undegraded":"2024-04-25T11:05:27.612083+0000","last_fullsized":"2024-04-25T11:05:27.612083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1901","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.871954+0000","last_change":"2024-04-25T10:38:59.354628+0000","last_active":"2024-04-25T11:05:30.871954+0000","last_peered":"2024-04-25T11:05:30.871954+0000","last_clean":"2024-04-25T11:05:30.871954+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:30.871954+0000","last_undegraded":"2024-04-25T11:05:30.871954+0000","last_fullsized":"2024-04-25T11:05:30.871954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6761","reported_seq":6889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.190334+0000","last_change":"2024-04-25T10:39:03.416632+0000","last_active":"2024-04-25T11:05:31.190334+0000","last_peered":"2024-04-25T11:05:31.190334+0000","last_clean":"2024-04-25T11:05:31.190334+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:31.190334+0000","last_undegraded":"2024-04-25T11:05:31.190334+0000","last_fullsized":"2024-04-25T11:05:31.190334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6761,"log_dups_size":0,"ondisk_log_size":6761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4765,"num_write_kb":131182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7164","reported_seq":7201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.598590+0000","last_change":"2024-04-25T10:38:58.376266+0000","last_active":"2024-04-25T11:05:27.598590+0000","last_peered":"2024-04-25T11:05:27.598590+0000","last_clean":"2024-04-25T11:05:27.598590+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:27.598590+0000","last_undegraded":"2024-04-25T11:05:27.598590+0000","last_fullsized":"2024-04-25T11:05:27.598590+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:36.410278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7165,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1946","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.930631+0000","last_change":"2024-04-25T10:38:59.361388+0000","last_active":"2024-04-25T11:05:30.930631+0000","last_peered":"2024-04-25T11:05:30.930631+0000","last_clean":"2024-04-25T11:05:30.930631+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:30.930631+0000","last_undegraded":"2024-04-25T11:05:30.930631+0000","last_fullsized":"2024-04-25T11:05:30.930631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6473","reported_seq":6689,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.252639+0000","last_change":"2024-04-25T10:39:39.057558+0000","last_active":"2024-04-25T11:05:31.252639+0000","last_peered":"2024-04-25T11:05:31.252639+0000","last_clean":"2024-04-25T11:05:31.252639+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:31.252639+0000","last_undegraded":"2024-04-25T11:05:31.252639+0000","last_fullsized":"2024-04-25T11:05:31.252639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6473,"log_dups_size":0,"ondisk_log_size":6473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:31.547009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4436,"num_write_kb":116918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3803","reported_seq":3840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.576789+0000","last_change":"2024-04-25T10:38:58.381650+0000","last_active":"2024-04-25T11:05:27.576789+0000","last_peered":"2024-04-25T11:05:27.576789+0000","last_clean":"2024-04-25T11:05:27.576789+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:27.576789+0000","last_undegraded":"2024-04-25T11:05:27.576789+0000","last_fullsized":"2024-04-25T11:05:27.576789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3803,"log_dups_size":0,"ondisk_log_size":3803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:57.757158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3806,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1896","reported_seq":1917,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.001899+0000","last_change":"2024-04-25T10:39:38.922901+0000","last_active":"2024-04-25T11:05:31.001899+0000","last_peered":"2024-04-25T11:05:31.001899+0000","last_clean":"2024-04-25T11:05:31.001899+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:31.001899+0000","last_undegraded":"2024-04-25T11:05:31.001899+0000","last_fullsized":"2024-04-25T11:05:31.001899+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6632","reported_seq":6753,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.146630+0000","last_change":"2024-04-25T10:39:03.412484+0000","last_active":"2024-04-25T11:05:31.146630+0000","last_peered":"2024-04-25T11:05:31.146630+0000","last_clean":"2024-04-25T11:05:31.146630+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:31.146630+0000","last_undegraded":"2024-04-25T11:05:31.146630+0000","last_fullsized":"2024-04-25T11:05:31.146630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6632,"log_dups_size":0,"ondisk_log_size":6632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.151432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4668,"num_write_kb":122166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1916","reported_seq":1953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.681317+0000","last_change":"2024-04-25T10:38:59.350145+0000","last_active":"2024-04-25T11:05:30.681317+0000","last_peered":"2024-04-25T11:05:30.681317+0000","last_clean":"2024-04-25T11:05:30.681317+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:30.681317+0000","last_undegraded":"2024-04-25T11:05:30.681317+0000","last_fullsized":"2024-04-25T11:05:30.681317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5505","reported_seq":5543,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.611231+0000","last_change":"2024-04-25T10:38:58.373415+0000","last_active":"2024-04-25T11:05:27.611231+0000","last_peered":"2024-04-25T11:05:27.611231+0000","last_clean":"2024-04-25T11:05:27.611231+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:05:27.611231+0000","last_undegraded":"2024-04-25T11:05:27.611231+0000","last_fullsized":"2024-04-25T11:05:27.611231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:05.925269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5522,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6773","reported_seq":6851,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.985773+0000","last_change":"2024-04-25T10:39:03.419459+0000","last_active":"2024-04-25T11:05:30.985773+0000","last_peered":"2024-04-25T11:05:30.985773+0000","last_clean":"2024-04-25T11:05:30.985773+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:30.985773+0000","last_undegraded":"2024-04-25T11:05:30.985773+0000","last_fullsized":"2024-04-25T11:05:30.985773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:31.214962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4716,"num_write_kb":126930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1925","reported_seq":1961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.145850+0000","last_change":"2024-04-25T10:38:59.339498+0000","last_active":"2024-04-25T11:05:31.145850+0000","last_peered":"2024-04-25T11:05:31.145850+0000","last_clean":"2024-04-25T11:05:31.145850+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:31.145850+0000","last_undegraded":"2024-04-25T11:05:31.145850+0000","last_fullsized":"2024-04-25T11:05:31.145850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4962","reported_seq":5003,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.595533+0000","last_change":"2024-04-25T10:38:58.337017+0000","last_active":"2024-04-25T11:05:27.595533+0000","last_peered":"2024-04-25T11:05:27.595533+0000","last_clean":"2024-04-25T11:05:27.595533+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:05:27.595533+0000","last_undegraded":"2024-04-25T11:05:27.595533+0000","last_fullsized":"2024-04-25T11:05:27.595533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4962,"log_dups_size":0,"ondisk_log_size":4962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4961,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7064","reported_seq":7164,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.923613+0000","last_change":"2024-04-25T10:39:03.427297+0000","last_active":"2024-04-25T11:05:30.923613+0000","last_peered":"2024-04-25T11:05:30.923613+0000","last_clean":"2024-04-25T11:05:30.923613+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:30.923613+0000","last_undegraded":"2024-04-25T11:05:30.923613+0000","last_fullsized":"2024-04-25T11:05:30.923613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:43.240492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5099,"num_write_kb":140880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1952","reported_seq":1989,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.643698+0000","last_change":"2024-04-25T10:38:59.323357+0000","last_active":"2024-04-25T11:05:30.643698+0000","last_peered":"2024-04-25T11:05:30.643698+0000","last_clean":"2024-04-25T11:05:30.643698+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:30.643698+0000","last_undegraded":"2024-04-25T11:05:30.643698+0000","last_fullsized":"2024-04-25T11:05:30.643698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:44.179610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2278","reported_seq":2319,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.597788+0000","last_change":"2024-04-25T10:38:58.354617+0000","last_active":"2024-04-25T11:05:27.597788+0000","last_peered":"2024-04-25T11:05:27.597788+0000","last_clean":"2024-04-25T11:05:27.597788+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:05:27.597788+0000","last_undegraded":"2024-04-25T11:05:27.597788+0000","last_fullsized":"2024-04-25T11:05:27.597788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2278,"log_dups_size":0,"ondisk_log_size":2278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2286,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6674","reported_seq":6818,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.788062+0000","last_change":"2024-04-25T10:39:04.080090+0000","last_active":"2024-04-25T11:05:30.788062+0000","last_peered":"2024-04-25T11:05:30.788062+0000","last_clean":"2024-04-25T11:05:30.788062+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:30.788062+0000","last_undegraded":"2024-04-25T11:05:30.788062+0000","last_fullsized":"2024-04-25T11:05:30.788062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6674,"log_dups_size":0,"ondisk_log_size":6674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4766,"num_write_kb":123430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1932","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.814522+0000","last_change":"2024-04-25T10:38:59.355699+0000","last_active":"2024-04-25T11:05:29.814522+0000","last_peered":"2024-04-25T11:05:29.814522+0000","last_clean":"2024-04-25T11:05:29.814522+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:29.814522+0000","last_undegraded":"2024-04-25T11:05:29.814522+0000","last_fullsized":"2024-04-25T11:05:29.814522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:58.766307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1620","reported_seq":1659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.606172+0000","last_change":"2024-04-25T10:38:58.375921+0000","last_active":"2024-04-25T11:05:27.606172+0000","last_peered":"2024-04-25T11:05:27.606172+0000","last_clean":"2024-04-25T11:05:27.606172+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:05:27.606172+0000","last_undegraded":"2024-04-25T11:05:27.606172+0000","last_fullsized":"2024-04-25T11:05:27.606172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1631,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7421","reported_seq":7522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.812567+0000","last_change":"2024-04-25T10:39:03.425133+0000","last_active":"2024-04-25T11:05:30.812567+0000","last_peered":"2024-04-25T11:05:30.812567+0000","last_clean":"2024-04-25T11:05:30.812567+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:30.812567+0000","last_undegraded":"2024-04-25T11:05:30.812567+0000","last_fullsized":"2024-04-25T11:05:30.812567+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5371,"num_write_kb":119270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1896","reported_seq":1934,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.293596+0000","last_change":"2024-04-25T10:38:59.346554+0000","last_active":"2024-04-25T11:05:31.293596+0000","last_peered":"2024-04-25T11:05:31.293596+0000","last_clean":"2024-04-25T11:05:31.293596+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:31.293596+0000","last_undegraded":"2024-04-25T11:05:31.293596+0000","last_fullsized":"2024-04-25T11:05:31.293596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2479","reported_seq":2518,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.622725+0000","last_change":"2024-04-25T10:38:58.378190+0000","last_active":"2024-04-25T11:05:27.622725+0000","last_peered":"2024-04-25T11:05:27.622725+0000","last_clean":"2024-04-25T11:05:27.622725+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:05:27.622725+0000","last_undegraded":"2024-04-25T11:05:27.622725+0000","last_fullsized":"2024-04-25T11:05:27.622725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2505,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6601","reported_seq":6706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.903264+0000","last_change":"2024-04-25T10:39:04.081531+0000","last_active":"2024-04-25T11:05:30.903264+0000","last_peered":"2024-04-25T11:05:30.903264+0000","last_clean":"2024-04-25T11:05:30.903264+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:30.903264+0000","last_undegraded":"2024-04-25T11:05:30.903264+0000","last_fullsized":"2024-04-25T11:05:30.903264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6601,"log_dups_size":0,"ondisk_log_size":6601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4630,"num_write_kb":127804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1852","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.740096+0000","last_change":"2024-04-25T10:38:59.372657+0000","last_active":"2024-04-25T11:05:30.740096+0000","last_peered":"2024-04-25T11:05:30.740096+0000","last_clean":"2024-04-25T11:05:30.740096+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:30.740096+0000","last_undegraded":"2024-04-25T11:05:30.740096+0000","last_fullsized":"2024-04-25T11:05:30.740096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4070","reported_seq":4184,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.520617+0000","last_change":"2024-04-25T10:38:58.363557+0000","last_active":"2024-04-25T11:05:30.520617+0000","last_peered":"2024-04-25T11:05:30.520617+0000","last_clean":"2024-04-25T11:05:30.520617+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:30.520617+0000","last_undegraded":"2024-04-25T11:05:30.520617+0000","last_fullsized":"2024-04-25T11:05:30.520617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":561401,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":596,"num_write":6804,"num_write_kb":36821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6499","reported_seq":6708,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.180963+0000","last_change":"2024-04-25T10:39:04.074697+0000","last_active":"2024-04-25T11:05:31.180963+0000","last_peered":"2024-04-25T11:05:31.180963+0000","last_clean":"2024-04-25T11:05:31.180963+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:31.180963+0000","last_undegraded":"2024-04-25T11:05:31.180963+0000","last_fullsized":"2024-04-25T11:05:31.180963+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6299,"log_dups_size":0,"ondisk_log_size":6299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:54.603852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4488,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1924","reported_seq":1963,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.868551+0000","last_change":"2024-04-25T10:38:59.320176+0000","last_active":"2024-04-25T11:05:30.868551+0000","last_peered":"2024-04-25T11:05:30.868551+0000","last_clean":"2024-04-25T11:05:30.868551+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:30.868551+0000","last_undegraded":"2024-04-25T11:05:30.868551+0000","last_fullsized":"2024-04-25T11:05:30.868551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4559","reported_seq":4598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.624995+0000","last_change":"2024-04-25T10:38:58.374819+0000","last_active":"2024-04-25T11:05:27.624995+0000","last_peered":"2024-04-25T11:05:27.624995+0000","last_clean":"2024-04-25T11:05:27.624995+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:05:27.624995+0000","last_undegraded":"2024-04-25T11:05:27.624995+0000","last_fullsized":"2024-04-25T11:05:27.624995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4559,"log_dups_size":0,"ondisk_log_size":4559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:11.435261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4570,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7286","reported_seq":7537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.077288+0000","last_change":"2024-04-25T10:39:39.090203+0000","last_active":"2024-04-25T11:05:31.077288+0000","last_peered":"2024-04-25T11:05:31.077288+0000","last_clean":"2024-04-25T11:05:31.077288+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:31.077288+0000","last_undegraded":"2024-04-25T11:05:31.077288+0000","last_fullsized":"2024-04-25T11:05:31.077288+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5277,"num_write_kb":159191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1892","reported_seq":1930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.818032+0000","last_change":"2024-04-25T10:38:59.337222+0000","last_active":"2024-04-25T11:05:30.818032+0000","last_peered":"2024-04-25T11:05:30.818032+0000","last_clean":"2024-04-25T11:05:30.818032+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:30.818032+0000","last_undegraded":"2024-04-25T11:05:30.818032+0000","last_fullsized":"2024-04-25T11:05:30.818032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4324","reported_seq":4365,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.609365+0000","last_change":"2024-04-25T10:38:58.342971+0000","last_active":"2024-04-25T11:05:27.609365+0000","last_peered":"2024-04-25T11:05:27.609365+0000","last_clean":"2024-04-25T11:05:27.609365+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:27.609365+0000","last_undegraded":"2024-04-25T11:05:27.609365+0000","last_fullsized":"2024-04-25T11:05:27.609365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4324,"log_dups_size":0,"ondisk_log_size":4324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4330,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7463","reported_seq":7757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.273975+0000","last_change":"2024-04-25T10:39:03.411394+0000","last_active":"2024-04-25T11:05:31.273975+0000","last_peered":"2024-04-25T11:05:31.273975+0000","last_clean":"2024-04-25T11:05:31.273975+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:31.273975+0000","last_undegraded":"2024-04-25T11:05:31.273975+0000","last_fullsized":"2024-04-25T11:05:31.273975+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7363,"log_dups_size":0,"ondisk_log_size":7363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5445,"num_write_kb":157562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1915","reported_seq":1953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.042876+0000","last_change":"2024-04-25T10:38:59.360734+0000","last_active":"2024-04-25T11:05:31.042876+0000","last_peered":"2024-04-25T11:05:31.042876+0000","last_clean":"2024-04-25T11:05:31.042876+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:31.042876+0000","last_undegraded":"2024-04-25T11:05:31.042876+0000","last_fullsized":"2024-04-25T11:05:31.042876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:37.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5571","reported_seq":5611,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.624215+0000","last_change":"2024-04-25T10:38:58.355358+0000","last_active":"2024-04-25T11:05:27.624215+0000","last_peered":"2024-04-25T11:05:27.624215+0000","last_clean":"2024-04-25T11:05:27.624215+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:05:27.624215+0000","last_undegraded":"2024-04-25T11:05:27.624215+0000","last_fullsized":"2024-04-25T11:05:27.624215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5571,"log_dups_size":0,"ondisk_log_size":5571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:22.450641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5576,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6966","reported_seq":7040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.944070+0000","last_change":"2024-04-25T10:39:03.399930+0000","last_active":"2024-04-25T11:05:30.944070+0000","last_peered":"2024-04-25T11:05:30.944070+0000","last_clean":"2024-04-25T11:05:30.944070+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:30.944070+0000","last_undegraded":"2024-04-25T11:05:30.944070+0000","last_fullsized":"2024-04-25T11:05:30.944070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6966,"log_dups_size":0,"ondisk_log_size":6966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4982,"num_write_kb":146653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1914","reported_seq":1954,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.188297+0000","last_change":"2024-04-25T10:38:59.321646+0000","last_active":"2024-04-25T11:05:31.188297+0000","last_peered":"2024-04-25T11:05:31.188297+0000","last_clean":"2024-04-25T11:05:31.188297+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:31.188297+0000","last_undegraded":"2024-04-25T11:05:31.188297+0000","last_fullsized":"2024-04-25T11:05:31.188297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6027","reported_seq":7464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.679741+0000","last_change":"2024-04-25T10:38:58.337183+0000","last_active":"2024-04-25T11:05:29.679741+0000","last_peered":"2024-04-25T11:05:29.679741+0000","last_clean":"2024-04-25T11:05:29.679741+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:05:29.679741+0000","last_undegraded":"2024-04-25T11:05:29.679741+0000","last_fullsized":"2024-04-25T11:05:29.679741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":6027,"log_dups_size":0,"ondisk_log_size":6027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6041,"num_write_kb":43946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6549","reported_seq":7091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.858978+0000","last_change":"2024-04-25T10:39:03.397792+0000","last_active":"2024-04-25T11:05:30.858978+0000","last_peered":"2024-04-25T11:05:30.858978+0000","last_clean":"2024-04-25T11:05:30.858978+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:30.858978+0000","last_undegraded":"2024-04-25T11:05:30.858978+0000","last_fullsized":"2024-04-25T11:05:30.858978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4580,"num_write_kb":125268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1830","reported_seq":1868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.086363+0000","last_change":"2024-04-25T10:38:59.364705+0000","last_active":"2024-04-25T11:05:31.086363+0000","last_peered":"2024-04-25T11:05:31.086363+0000","last_clean":"2024-04-25T11:05:31.086363+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:31.086363+0000","last_undegraded":"2024-04-25T11:05:31.086363+0000","last_fullsized":"2024-04-25T11:05:31.086363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5533","reported_seq":5573,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.610239+0000","last_change":"2024-04-25T10:38:58.373855+0000","last_active":"2024-04-25T11:05:27.610239+0000","last_peered":"2024-04-25T11:05:27.610239+0000","last_clean":"2024-04-25T11:05:27.610239+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:27.610239+0000","last_undegraded":"2024-04-25T11:05:27.610239+0000","last_fullsized":"2024-04-25T11:05:27.610239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5533,"log_dups_size":0,"ondisk_log_size":5533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:29.542440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5542,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6641","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.315939+0000","last_change":"2024-04-25T10:39:04.077590+0000","last_active":"2024-04-25T11:05:31.315939+0000","last_peered":"2024-04-25T11:05:31.315939+0000","last_clean":"2024-04-25T11:05:31.315939+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:31.315939+0000","last_undegraded":"2024-04-25T11:05:31.315939+0000","last_fullsized":"2024-04-25T11:05:31.315939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6641,"log_dups_size":0,"ondisk_log_size":6641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4590,"num_write_kb":120036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1945","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.216704+0000","last_change":"2024-04-25T10:38:59.351689+0000","last_active":"2024-04-25T11:05:31.216704+0000","last_peered":"2024-04-25T11:05:31.216704+0000","last_clean":"2024-04-25T11:05:31.216704+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:31.216704+0000","last_undegraded":"2024-04-25T11:05:31.216704+0000","last_fullsized":"2024-04-25T11:05:31.216704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3771","reported_seq":3811,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.610368+0000","last_change":"2024-04-25T10:38:58.354290+0000","last_active":"2024-04-25T11:05:27.610368+0000","last_peered":"2024-04-25T11:05:27.610368+0000","last_clean":"2024-04-25T11:05:27.610368+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:05:27.610368+0000","last_undegraded":"2024-04-25T11:05:27.610368+0000","last_fullsized":"2024-04-25T11:05:27.610368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3771,"log_dups_size":0,"ondisk_log_size":3771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3784,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:02:55.392906+0000","last_change":"2024-04-25T10:38:47.759083+0000","last_active":"2024-04-25T11:02:55.392906+0000","last_peered":"2024-04-25T11:02:55.392906+0000","last_clean":"2024-04-25T11:02:55.392906+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:02:55.392906+0000","last_undegraded":"2024-04-25T11:02:55.392906+0000","last_fullsized":"2024-04-25T11:02:55.392906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:46.231102+0000","last_clean_scrub_stamp":"2024-04-25T10:38:46.231102+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:02.428455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6746","reported_seq":6881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.925973+0000","last_change":"2024-04-25T10:39:04.080286+0000","last_active":"2024-04-25T11:05:30.925973+0000","last_peered":"2024-04-25T11:05:30.925973+0000","last_clean":"2024-04-25T11:05:30.925973+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:30.925973+0000","last_undegraded":"2024-04-25T11:05:30.925973+0000","last_fullsized":"2024-04-25T11:05:30.925973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6746,"log_dups_size":0,"ondisk_log_size":6746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:07.592998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4798,"num_write_kb":130135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1910","reported_seq":1946,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.849661+0000","last_change":"2024-04-25T10:38:59.354353+0000","last_active":"2024-04-25T11:05:29.849661+0000","last_peered":"2024-04-25T11:05:29.849661+0000","last_clean":"2024-04-25T11:05:29.849661+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:29.849661+0000","last_undegraded":"2024-04-25T11:05:29.849661+0000","last_fullsized":"2024-04-25T11:05:29.849661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1910,"log_dups_size":0,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4304","reported_seq":4344,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.599919+0000","last_change":"2024-04-25T10:38:58.379702+0000","last_active":"2024-04-25T11:05:27.599919+0000","last_peered":"2024-04-25T11:05:27.599919+0000","last_clean":"2024-04-25T11:05:27.599919+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:05:27.599919+0000","last_undegraded":"2024-04-25T11:05:27.599919+0000","last_fullsized":"2024-04-25T11:05:27.599919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4304,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6656","reported_seq":6880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.131394+0000","last_change":"2024-04-25T10:39:04.076450+0000","last_active":"2024-04-25T11:05:31.131394+0000","last_peered":"2024-04-25T11:05:31.131394+0000","last_clean":"2024-04-25T11:05:31.131394+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:31.131394+0000","last_undegraded":"2024-04-25T11:05:31.131394+0000","last_fullsized":"2024-04-25T11:05:31.131394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6656,"log_dups_size":0,"ondisk_log_size":6656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4615,"num_write_kb":121061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1900","reported_seq":1937,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.944952+0000","last_change":"2024-04-25T10:38:59.339156+0000","last_active":"2024-04-25T11:05:30.944952+0000","last_peered":"2024-04-25T11:05:30.944952+0000","last_clean":"2024-04-25T11:05:30.944952+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:30.944952+0000","last_undegraded":"2024-04-25T11:05:30.944952+0000","last_fullsized":"2024-04-25T11:05:30.944952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1900,"log_dups_size":0,"ondisk_log_size":1900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5440","reported_seq":5480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.575067+0000","last_change":"2024-04-25T10:38:58.350699+0000","last_active":"2024-04-25T11:05:27.575067+0000","last_peered":"2024-04-25T11:05:27.575067+0000","last_clean":"2024-04-25T11:05:27.575067+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:05:27.575067+0000","last_undegraded":"2024-04-25T11:05:27.575067+0000","last_fullsized":"2024-04-25T11:05:27.575067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5441,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6687","reported_seq":7004,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.220690+0000","last_change":"2024-04-25T10:39:03.410746+0000","last_active":"2024-04-25T11:05:31.220690+0000","last_peered":"2024-04-25T11:05:31.220690+0000","last_clean":"2024-04-25T11:05:31.220690+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:31.220690+0000","last_undegraded":"2024-04-25T11:05:31.220690+0000","last_fullsized":"2024-04-25T11:05:31.220690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6687,"log_dups_size":0,"ondisk_log_size":6687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4636,"num_write_kb":135921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1836","reported_seq":1858,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.728773+0000","last_change":"2024-04-25T10:39:38.923770+0000","last_active":"2024-04-25T11:05:30.728773+0000","last_peered":"2024-04-25T11:05:30.728773+0000","last_clean":"2024-04-25T11:05:30.728773+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:30.728773+0000","last_undegraded":"2024-04-25T11:05:30.728773+0000","last_fullsized":"2024-04-25T11:05:30.728773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4834","reported_seq":4874,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.618687+0000","last_change":"2024-04-25T10:38:58.339837+0000","last_active":"2024-04-25T11:05:27.618687+0000","last_peered":"2024-04-25T11:05:27.618687+0000","last_clean":"2024-04-25T11:05:27.618687+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:27.618687+0000","last_undegraded":"2024-04-25T11:05:27.618687+0000","last_fullsized":"2024-04-25T11:05:27.618687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4834,"log_dups_size":0,"ondisk_log_size":4834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4839,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7079","reported_seq":7146,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.648609+0000","last_change":"2024-04-25T10:39:04.084416+0000","last_active":"2024-04-25T11:05:30.648609+0000","last_peered":"2024-04-25T11:05:30.648609+0000","last_clean":"2024-04-25T11:05:30.648609+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:30.648609+0000","last_undegraded":"2024-04-25T11:05:30.648609+0000","last_fullsized":"2024-04-25T11:05:30.648609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":7079,"log_dups_size":0,"ondisk_log_size":7079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:40.480594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5048,"num_write_kb":119873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1923","reported_seq":1959,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.809751+0000","last_change":"2024-04-25T10:38:59.367874+0000","last_active":"2024-04-25T11:05:30.809751+0000","last_peered":"2024-04-25T11:05:30.809751+0000","last_clean":"2024-04-25T11:05:30.809751+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:30.809751+0000","last_undegraded":"2024-04-25T11:05:30.809751+0000","last_fullsized":"2024-04-25T11:05:30.809751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:36.303534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3722","reported_seq":3761,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.620460+0000","last_change":"2024-04-25T10:38:58.352853+0000","last_active":"2024-04-25T11:05:27.620460+0000","last_peered":"2024-04-25T11:05:27.620460+0000","last_clean":"2024-04-25T11:05:27.620460+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:27.620460+0000","last_undegraded":"2024-04-25T11:05:27.620460+0000","last_fullsized":"2024-04-25T11:05:27.620460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3722,"log_dups_size":0,"ondisk_log_size":3722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:34.456210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3720,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6596","reported_seq":6720,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.084040+0000","last_change":"2024-04-25T10:39:03.418352+0000","last_active":"2024-04-25T11:05:31.084040+0000","last_peered":"2024-04-25T11:05:31.084040+0000","last_clean":"2024-04-25T11:05:31.084040+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:31.084040+0000","last_undegraded":"2024-04-25T11:05:31.084040+0000","last_fullsized":"2024-04-25T11:05:31.084040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6596,"log_dups_size":0,"ondisk_log_size":6596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:39.013550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4504,"num_write_kb":119124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1943","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.088683+0000","last_change":"2024-04-25T10:38:59.369027+0000","last_active":"2024-04-25T11:05:31.088683+0000","last_peered":"2024-04-25T11:05:31.088683+0000","last_clean":"2024-04-25T11:05:31.088683+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:31.088683+0000","last_undegraded":"2024-04-25T11:05:31.088683+0000","last_fullsized":"2024-04-25T11:05:31.088683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:27.091118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2221","reported_seq":2261,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.522658+0000","last_change":"2024-04-25T10:38:58.331286+0000","last_active":"2024-04-25T11:05:30.522658+0000","last_peered":"2024-04-25T11:05:30.522658+0000","last_clean":"2024-04-25T11:05:30.522658+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:05:30.522658+0000","last_undegraded":"2024-04-25T11:05:30.522658+0000","last_fullsized":"2024-04-25T11:05:30.522658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":2221,"log_dups_size":0,"ondisk_log_size":2221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2236,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6569","reported_seq":6820,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.313368+0000","last_change":"2024-04-25T10:39:03.415559+0000","last_active":"2024-04-25T11:05:31.313368+0000","last_peered":"2024-04-25T11:05:31.313368+0000","last_clean":"2024-04-25T11:05:31.313368+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:31.313368+0000","last_undegraded":"2024-04-25T11:05:31.313368+0000","last_fullsized":"2024-04-25T11:05:31.313368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6569,"log_dups_size":0,"ondisk_log_size":6569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4527,"num_write_kb":127214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1852","reported_seq":1888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.850337+0000","last_change":"2024-04-25T10:38:59.342907+0000","last_active":"2024-04-25T11:05:29.850337+0000","last_peered":"2024-04-25T11:05:29.850337+0000","last_clean":"2024-04-25T11:05:29.850337+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:29.850337+0000","last_undegraded":"2024-04-25T11:05:29.850337+0000","last_fullsized":"2024-04-25T11:05:29.850337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1712","reported_seq":1750,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.619226+0000","last_change":"2024-04-25T10:38:58.354579+0000","last_active":"2024-04-25T11:05:27.619226+0000","last_peered":"2024-04-25T11:05:27.619226+0000","last_clean":"2024-04-25T11:05:27.619226+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:05:27.619226+0000","last_undegraded":"2024-04-25T11:05:27.619226+0000","last_fullsized":"2024-04-25T11:05:27.619226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1712,"log_dups_size":0,"ondisk_log_size":1712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:42.028716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195291,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1716,"num_write_kb":21294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6817","reported_seq":6908,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.735905+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T11:05:30.735905+0000","last_peered":"2024-04-25T11:05:30.735905+0000","last_clean":"2024-04-25T11:05:30.735905+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:30.735905+0000","last_undegraded":"2024-04-25T11:05:30.735905+0000","last_fullsized":"2024-04-25T11:05:30.735905+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6313,"log_dups_size":0,"ondisk_log_size":6313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:33.025597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4812,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1911","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.889532+0000","last_change":"2024-04-25T10:38:59.371827+0000","last_active":"2024-04-25T11:05:29.889532+0000","last_peered":"2024-04-25T11:05:29.889532+0000","last_clean":"2024-04-25T11:05:29.889532+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:29.889532+0000","last_undegraded":"2024-04-25T11:05:29.889532+0000","last_fullsized":"2024-04-25T11:05:29.889532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1356","reported_seq":1395,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.598168+0000","last_change":"2024-04-25T10:38:58.369154+0000","last_active":"2024-04-25T11:05:27.598168+0000","last_peered":"2024-04-25T11:05:27.598168+0000","last_clean":"2024-04-25T11:05:27.598168+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:05:27.598168+0000","last_undegraded":"2024-04-25T11:05:27.598168+0000","last_fullsized":"2024-04-25T11:05:27.598168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1362,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6439","reported_seq":6653,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.926507+0000","last_change":"2024-04-25T10:39:39.093855+0000","last_active":"2024-04-25T11:05:30.926507+0000","last_peered":"2024-04-25T11:05:30.926507+0000","last_clean":"2024-04-25T11:05:30.926507+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:30.926507+0000","last_undegraded":"2024-04-25T11:05:30.926507+0000","last_fullsized":"2024-04-25T11:05:30.926507+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6339,"log_dups_size":0,"ondisk_log_size":6339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:55.407701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4468,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1931","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.307874+0000","last_change":"2024-04-25T10:38:59.354517+0000","last_active":"2024-04-25T11:05:31.307874+0000","last_peered":"2024-04-25T11:05:31.307874+0000","last_clean":"2024-04-25T11:05:31.307874+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:31.307874+0000","last_undegraded":"2024-04-25T11:05:31.307874+0000","last_fullsized":"2024-04-25T11:05:31.307874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3878","reported_seq":3925,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.785709+0000","last_change":"2024-04-25T11:05:35.785763+0000","last_active":"2024-04-25T11:05:35.785709+0000","last_peered":"2024-04-25T11:05:35.785709+0000","last_clean":"2024-04-25T11:05:35.785709+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:05:35.785709+0000","last_undegraded":"2024-04-25T11:05:35.785709+0000","last_fullsized":"2024-04-25T11:05:35.785709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3878","last_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_deep_scrub":"28'3878","last_deep_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.785612+0000","objects_scrubbed":7,"log_size":3878,"log_dups_size":0,"ondisk_log_size":3878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:06.809043+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3882,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6424","reported_seq":6619,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.588925+0000","last_change":"2024-04-25T10:39:04.078945+0000","last_active":"2024-04-25T11:05:30.588925+0000","last_peered":"2024-04-25T11:05:30.588925+0000","last_clean":"2024-04-25T11:05:30.588925+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:30.588925+0000","last_undegraded":"2024-04-25T11:05:30.588925+0000","last_fullsized":"2024-04-25T11:05:30.588925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6424,"log_dups_size":0,"ondisk_log_size":6424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:15.488243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4474,"num_write_kb":118590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1853","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.573912+0000","last_change":"2024-04-25T10:38:59.354668+0000","last_active":"2024-04-25T11:05:30.573912+0000","last_peered":"2024-04-25T11:05:30.573912+0000","last_clean":"2024-04-25T11:05:30.573912+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:30.573912+0000","last_undegraded":"2024-04-25T11:05:30.573912+0000","last_fullsized":"2024-04-25T11:05:30.573912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7364","reported_seq":8027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:32.227112+0000","last_change":"2024-04-25T10:38:58.362373+0000","last_active":"2024-04-25T11:05:32.227112+0000","last_peered":"2024-04-25T11:05:32.227112+0000","last_clean":"2024-04-25T11:05:32.227112+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:32.227112+0000","last_undegraded":"2024-04-25T11:05:32.227112+0000","last_fullsized":"2024-04-25T11:05:32.227112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7364,"log_dups_size":0,"ondisk_log_size":7364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19525194,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7373,"num_write_kb":55479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6574","reported_seq":6639,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.309075+0000","last_change":"2024-04-25T10:39:03.399480+0000","last_active":"2024-04-25T11:05:31.309075+0000","last_peered":"2024-04-25T11:05:31.309075+0000","last_clean":"2024-04-25T11:05:31.309075+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:31.309075+0000","last_undegraded":"2024-04-25T11:05:31.309075+0000","last_fullsized":"2024-04-25T11:05:31.309075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6574,"log_dups_size":0,"ondisk_log_size":6574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4583,"num_write_kb":116164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1899","reported_seq":1936,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.901983+0000","last_change":"2024-04-25T10:38:59.359658+0000","last_active":"2024-04-25T11:05:30.901983+0000","last_peered":"2024-04-25T11:05:30.901983+0000","last_clean":"2024-04-25T11:05:30.901983+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:30.901983+0000","last_undegraded":"2024-04-25T11:05:30.901983+0000","last_fullsized":"2024-04-25T11:05:30.901983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1899,"log_dups_size":0,"ondisk_log_size":1899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:23.459791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5165","reported_seq":5205,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:34.471497+0000","last_change":"2024-04-25T10:38:58.370039+0000","last_active":"2024-04-25T11:05:34.471497+0000","last_peered":"2024-04-25T11:05:34.471497+0000","last_clean":"2024-04-25T11:05:34.471497+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:34.471497+0000","last_undegraded":"2024-04-25T11:05:34.471497+0000","last_fullsized":"2024-04-25T11:05:34.471497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5165,"log_dups_size":0,"ondisk_log_size":5165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5172,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6464","reported_seq":6521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.210884+0000","last_change":"2024-04-25T10:39:03.426477+0000","last_active":"2024-04-25T11:05:31.210884+0000","last_peered":"2024-04-25T11:05:31.210884+0000","last_clean":"2024-04-25T11:05:31.210884+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:31.210884+0000","last_undegraded":"2024-04-25T11:05:31.210884+0000","last_fullsized":"2024-04-25T11:05:31.210884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6464,"log_dups_size":0,"ondisk_log_size":6464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.324622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4399,"num_write_kb":121932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1922","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:34.673075+0000","last_change":"2024-04-25T11:05:34.673075+0000","last_active":"2024-04-25T11:05:34.673075+0000","last_peered":"2024-04-25T11:05:34.673075+0000","last_clean":"2024-04-25T11:05:34.673075+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:34.673075+0000","last_undegraded":"2024-04-25T11:05:34.673075+0000","last_fullsized":"2024-04-25T11:05:34.673075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1922","last_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_deep_scrub":"28'1922","last_deep_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_clean_scrub_stamp":"2024-04-25T11:05:34.672946+0000","objects_scrubbed":0,"log_size":1922,"log_dups_size":0,"ondisk_log_size":1922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:11.794352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5286","reported_seq":5325,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.606295+0000","last_change":"2024-04-25T10:38:58.369661+0000","last_active":"2024-04-25T11:05:27.606295+0000","last_peered":"2024-04-25T11:05:27.606295+0000","last_clean":"2024-04-25T11:05:27.606295+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:05:27.606295+0000","last_undegraded":"2024-04-25T11:05:27.606295+0000","last_fullsized":"2024-04-25T11:05:27.606295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5286,"log_dups_size":0,"ondisk_log_size":5286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5291,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6505","reported_seq":6841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.117368+0000","last_change":"2024-04-25T10:39:03.402956+0000","last_active":"2024-04-25T11:05:31.117368+0000","last_peered":"2024-04-25T11:05:31.117368+0000","last_clean":"2024-04-25T11:05:31.117368+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:31.117368+0000","last_undegraded":"2024-04-25T11:05:31.117368+0000","last_fullsized":"2024-04-25T11:05:31.117368+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:15:43.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4587,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1886","reported_seq":1907,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.310369+0000","last_change":"2024-04-25T10:39:38.920344+0000","last_active":"2024-04-25T11:05:31.310369+0000","last_peered":"2024-04-25T11:05:31.310369+0000","last_clean":"2024-04-25T11:05:31.310369+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:31.310369+0000","last_undegraded":"2024-04-25T11:05:31.310369+0000","last_fullsized":"2024-04-25T11:05:31.310369+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1886,"log_dups_size":0,"ondisk_log_size":1886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4612","reported_seq":5263,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.680810+0000","last_change":"2024-04-25T10:38:58.373050+0000","last_active":"2024-04-25T11:05:29.680810+0000","last_peered":"2024-04-25T11:05:29.680810+0000","last_clean":"2024-04-25T11:05:29.680810+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:29.680810+0000","last_undegraded":"2024-04-25T11:05:29.680810+0000","last_fullsized":"2024-04-25T11:05:29.680810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":4612,"log_dups_size":0,"ondisk_log_size":4612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:48:36.182565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4610,"num_write_kb":39070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6806","reported_seq":7243,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.176806+0000","last_change":"2024-04-25T10:39:04.076426+0000","last_active":"2024-04-25T11:05:31.176806+0000","last_peered":"2024-04-25T11:05:31.176806+0000","last_clean":"2024-04-25T11:05:31.176806+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:31.176806+0000","last_undegraded":"2024-04-25T11:05:31.176806+0000","last_fullsized":"2024-04-25T11:05:31.176806+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:22.387079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4777,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6723","reported_seq":6860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.308943+0000","last_change":"2024-04-25T10:39:04.078562+0000","last_active":"2024-04-25T11:05:31.308943+0000","last_peered":"2024-04-25T11:05:31.308943+0000","last_clean":"2024-04-25T11:05:31.308943+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:31.308943+0000","last_undegraded":"2024-04-25T11:05:31.308943+0000","last_fullsized":"2024-04-25T11:05:31.308943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6723,"log_dups_size":0,"ondisk_log_size":6723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4788,"num_write_kb":128894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1850","reported_seq":1896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.275167+0000","last_change":"2024-04-25T11:05:35.275167+0000","last_active":"2024-04-25T11:05:35.275167+0000","last_peered":"2024-04-25T11:05:35.275167+0000","last_clean":"2024-04-25T11:05:35.275167+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:35.275167+0000","last_undegraded":"2024-04-25T11:05:35.275167+0000","last_fullsized":"2024-04-25T11:05:35.275167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1850","last_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_deep_scrub":"28'1850","last_deep_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.275042+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:12.396448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7631","reported_seq":7670,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:17.560935+0000","last_change":"2024-04-25T10:38:58.369448+0000","last_active":"2024-04-25T11:05:17.560935+0000","last_peered":"2024-04-25T11:05:17.560935+0000","last_clean":"2024-04-25T11:05:17.560935+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:17.560935+0000","last_undegraded":"2024-04-25T11:05:17.560935+0000","last_fullsized":"2024-04-25T11:05:17.560935+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7331,"log_dups_size":0,"ondisk_log_size":7331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:53.383748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6433","reported_seq":6763,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.663286+0000","last_change":"2024-04-25T10:39:03.417798+0000","last_active":"2024-04-25T11:05:30.663286+0000","last_peered":"2024-04-25T11:05:30.663286+0000","last_clean":"2024-04-25T11:05:30.663286+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:30.663286+0000","last_undegraded":"2024-04-25T11:05:30.663286+0000","last_fullsized":"2024-04-25T11:05:30.663286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.138895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4458,"num_write_kb":135113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1942","reported_seq":1977,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.172087+0000","last_change":"2024-04-25T10:38:59.337223+0000","last_active":"2024-04-25T11:05:31.172087+0000","last_peered":"2024-04-25T11:05:31.172087+0000","last_clean":"2024-04-25T11:05:31.172087+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:31.172087+0000","last_undegraded":"2024-04-25T11:05:31.172087+0000","last_fullsized":"2024-04-25T11:05:31.172087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:47.836880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3989","reported_seq":4026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:03:52.467207+0000","last_change":"2024-04-25T10:38:58.344426+0000","last_active":"2024-04-25T11:03:52.467207+0000","last_peered":"2024-04-25T11:03:52.467207+0000","last_clean":"2024-04-25T11:03:52.467207+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:03:52.467207+0000","last_undegraded":"2024-04-25T11:03:52.467207+0000","last_fullsized":"2024-04-25T11:03:52.467207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":3989,"log_dups_size":0,"ondisk_log_size":3989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:05.432551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7615","reported_seq":7652,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:04:56.900367+0000","last_change":"2024-04-25T10:38:58.360779+0000","last_active":"2024-04-25T11:04:56.900367+0000","last_peered":"2024-04-25T11:04:56.900367+0000","last_clean":"2024-04-25T11:04:56.900367+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:04:56.900367+0000","last_undegraded":"2024-04-25T11:04:56.900367+0000","last_fullsized":"2024-04-25T11:04:56.900367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":7615,"log_dups_size":0,"ondisk_log_size":7615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7611,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1866","reported_seq":1902,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.257267+0000","last_change":"2024-04-25T10:38:59.360920+0000","last_active":"2024-04-25T11:05:31.257267+0000","last_peered":"2024-04-25T11:05:31.257267+0000","last_clean":"2024-04-25T11:05:31.257267+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:31.257267+0000","last_undegraded":"2024-04-25T11:05:31.257267+0000","last_fullsized":"2024-04-25T11:05:31.257267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6829","reported_seq":6914,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.024308+0000","last_change":"2024-04-25T10:39:03.395797+0000","last_active":"2024-04-25T11:05:31.024308+0000","last_peered":"2024-04-25T11:05:31.024308+0000","last_clean":"2024-04-25T11:05:31.024308+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:31.024308+0000","last_undegraded":"2024-04-25T11:05:31.024308+0000","last_fullsized":"2024-04-25T11:05:31.024308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6829,"log_dups_size":0,"ondisk_log_size":6829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4770,"num_write_kb":143218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5972","reported_seq":6009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:27.617686+0000","last_change":"2024-04-25T10:38:58.354550+0000","last_active":"2024-04-25T11:05:27.617686+0000","last_peered":"2024-04-25T11:05:27.617686+0000","last_clean":"2024-04-25T11:05:27.617686+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:27.617686+0000","last_undegraded":"2024-04-25T11:05:27.617686+0000","last_fullsized":"2024-04-25T11:05:27.617686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:57.294669+0000","last_clean_scrub_stamp":"2024-04-25T10:38:57.294669+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:41.480395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1925","reported_seq":1961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.985894+0000","last_change":"2024-04-25T10:38:59.356477+0000","last_active":"2024-04-25T11:05:30.985894+0000","last_peered":"2024-04-25T11:05:30.985894+0000","last_clean":"2024-04-25T11:05:30.985894+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:30.985894+0000","last_undegraded":"2024-04-25T11:05:30.985894+0000","last_fullsized":"2024-04-25T11:05:30.985894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:54.392898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7364","reported_seq":7917,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.028046+0000","last_change":"2024-04-25T10:39:03.407583+0000","last_active":"2024-04-25T11:05:31.028046+0000","last_peered":"2024-04-25T11:05:31.028046+0000","last_clean":"2024-04-25T11:05:31.028046+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:31.028046+0000","last_undegraded":"2024-04-25T11:05:31.028046+0000","last_fullsized":"2024-04-25T11:05:31.028046+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.840923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5337,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1843","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.137513+0000","last_change":"2024-04-25T10:38:59.348102+0000","last_active":"2024-04-25T11:05:31.137513+0000","last_peered":"2024-04-25T11:05:31.137513+0000","last_clean":"2024-04-25T11:05:31.137513+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:31.137513+0000","last_undegraded":"2024-04-25T11:05:31.137513+0000","last_fullsized":"2024-04-25T11:05:31.137513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1947","reported_seq":1986,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.896635+0000","last_change":"2024-04-25T10:38:59.332404+0000","last_active":"2024-04-25T11:05:30.896635+0000","last_peered":"2024-04-25T11:05:30.896635+0000","last_clean":"2024-04-25T11:05:30.896635+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:30.896635+0000","last_undegraded":"2024-04-25T11:05:30.896635+0000","last_fullsized":"2024-04-25T11:05:30.896635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1853","reported_seq":1891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.229333+0000","last_change":"2024-04-25T10:38:59.338557+0000","last_active":"2024-04-25T11:05:31.229333+0000","last_peered":"2024-04-25T11:05:31.229333+0000","last_clean":"2024-04-25T11:05:31.229333+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:31.229333+0000","last_undegraded":"2024-04-25T11:05:31.229333+0000","last_fullsized":"2024-04-25T11:05:31.229333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1943","reported_seq":1986,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.072552+0000","last_change":"2024-04-25T10:39:38.921341+0000","last_active":"2024-04-25T11:05:31.072552+0000","last_peered":"2024-04-25T11:05:31.072552+0000","last_clean":"2024-04-25T11:05:31.072552+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:31.072552+0000","last_undegraded":"2024-04-25T11:05:31.072552+0000","last_fullsized":"2024-04-25T11:05:31.072552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1942","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.804277+0000","last_change":"2024-04-25T10:38:59.362060+0000","last_active":"2024-04-25T11:05:30.804277+0000","last_peered":"2024-04-25T11:05:30.804277+0000","last_clean":"2024-04-25T11:05:30.804277+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:30.804277+0000","last_undegraded":"2024-04-25T11:05:30.804277+0000","last_fullsized":"2024-04-25T11:05:30.804277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1847","reported_seq":1894,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.335562+0000","last_change":"2024-04-25T11:05:36.335608+0000","last_active":"2024-04-25T11:05:36.335562+0000","last_peered":"2024-04-25T11:05:36.335562+0000","last_clean":"2024-04-25T11:05:36.335562+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:36.335562+0000","last_undegraded":"2024-04-25T11:05:36.335562+0000","last_fullsized":"2024-04-25T11:05:36.335562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1847","last_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_deep_scrub":"28'1847","last_deep_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.335456+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.358886+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1948","reported_seq":1985,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.267291+0000","last_change":"2024-04-25T10:38:59.353876+0000","last_active":"2024-04-25T11:05:31.267291+0000","last_peered":"2024-04-25T11:05:31.267291+0000","last_clean":"2024-04-25T11:05:31.267291+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:31.267291+0000","last_undegraded":"2024-04-25T11:05:31.267291+0000","last_fullsized":"2024-04-25T11:05:31.267291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1915","reported_seq":1952,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.836275+0000","last_change":"2024-04-25T10:38:59.355154+0000","last_active":"2024-04-25T11:05:29.836275+0000","last_peered":"2024-04-25T11:05:29.836275+0000","last_clean":"2024-04-25T11:05:29.836275+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:29.836275+0000","last_undegraded":"2024-04-25T11:05:29.836275+0000","last_fullsized":"2024-04-25T11:05:29.836275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:11.574098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1873","reported_seq":1911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.854842+0000","last_change":"2024-04-25T10:38:59.341663+0000","last_active":"2024-04-25T11:05:29.854842+0000","last_peered":"2024-04-25T11:05:29.854842+0000","last_clean":"2024-04-25T11:05:29.854842+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:29.854842+0000","last_undegraded":"2024-04-25T11:05:29.854842+0000","last_fullsized":"2024-04-25T11:05:29.854842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1873,"log_dups_size":0,"ondisk_log_size":1873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:54.466970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1913","reported_seq":1949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.086979+0000","last_change":"2024-04-25T10:38:59.360189+0000","last_active":"2024-04-25T11:05:31.086979+0000","last_peered":"2024-04-25T11:05:31.086979+0000","last_clean":"2024-04-25T11:05:31.086979+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:31.086979+0000","last_undegraded":"2024-04-25T11:05:31.086979+0000","last_fullsized":"2024-04-25T11:05:31.086979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1928","reported_seq":1965,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.115952+0000","last_change":"2024-04-25T10:38:59.353078+0000","last_active":"2024-04-25T11:05:31.115952+0000","last_peered":"2024-04-25T11:05:31.115952+0000","last_clean":"2024-04-25T11:05:31.115952+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:31.115952+0000","last_undegraded":"2024-04-25T11:05:31.115952+0000","last_fullsized":"2024-04-25T11:05:31.115952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1928,"log_dups_size":0,"ondisk_log_size":1928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:48.568966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1930","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.210217+0000","last_change":"2024-04-25T10:38:59.354154+0000","last_active":"2024-04-25T11:05:31.210217+0000","last_peered":"2024-04-25T11:05:31.210217+0000","last_clean":"2024-04-25T11:05:31.210217+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:31.210217+0000","last_undegraded":"2024-04-25T11:05:31.210217+0000","last_fullsized":"2024-04-25T11:05:31.210217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1903","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.766964+0000","last_change":"2024-04-25T10:38:59.368684+0000","last_active":"2024-04-25T11:05:30.766964+0000","last_peered":"2024-04-25T11:05:30.766964+0000","last_clean":"2024-04-25T11:05:30.766964+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:30.766964+0000","last_undegraded":"2024-04-25T11:05:30.766964+0000","last_fullsized":"2024-04-25T11:05:30.766964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:19.558061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1959","reported_seq":1995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.954039+0000","last_change":"2024-04-25T10:38:59.363225+0000","last_active":"2024-04-25T11:05:30.954039+0000","last_peered":"2024-04-25T11:05:30.954039+0000","last_clean":"2024-04-25T11:05:30.954039+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:30.954039+0000","last_undegraded":"2024-04-25T11:05:30.954039+0000","last_fullsized":"2024-04-25T11:05:30.954039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:48.279288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1860","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.773231+0000","last_change":"2024-04-25T10:38:59.343474+0000","last_active":"2024-04-25T11:05:30.773231+0000","last_peered":"2024-04-25T11:05:30.773231+0000","last_clean":"2024-04-25T11:05:30.773231+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:30.773231+0000","last_undegraded":"2024-04-25T11:05:30.773231+0000","last_fullsized":"2024-04-25T11:05:30.773231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1907","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.725146+0000","last_change":"2024-04-25T10:38:59.371259+0000","last_active":"2024-04-25T11:05:30.725146+0000","last_peered":"2024-04-25T11:05:30.725146+0000","last_clean":"2024-04-25T11:05:30.725146+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:30.725146+0000","last_undegraded":"2024-04-25T11:05:30.725146+0000","last_fullsized":"2024-04-25T11:05:30.725146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1838","reported_seq":1875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.099921+0000","last_change":"2024-04-25T10:38:59.341832+0000","last_active":"2024-04-25T11:05:31.099921+0000","last_peered":"2024-04-25T11:05:31.099921+0000","last_clean":"2024-04-25T11:05:31.099921+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:31.099921+0000","last_undegraded":"2024-04-25T11:05:31.099921+0000","last_fullsized":"2024-04-25T11:05:31.099921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1959","reported_seq":1997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.185068+0000","last_change":"2024-04-25T10:38:59.360267+0000","last_active":"2024-04-25T11:05:31.185068+0000","last_peered":"2024-04-25T11:05:31.185068+0000","last_clean":"2024-04-25T11:05:31.185068+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:31.185068+0000","last_undegraded":"2024-04-25T11:05:31.185068+0000","last_fullsized":"2024-04-25T11:05:31.185068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1864","reported_seq":1901,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.308833+0000","last_change":"2024-04-25T10:38:59.340146+0000","last_active":"2024-04-25T11:05:31.308833+0000","last_peered":"2024-04-25T11:05:31.308833+0000","last_clean":"2024-04-25T11:05:31.308833+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:31.308833+0000","last_undegraded":"2024-04-25T11:05:31.308833+0000","last_fullsized":"2024-04-25T11:05:31.308833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1864,"log_dups_size":0,"ondisk_log_size":1864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1879","reported_seq":1915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.196396+0000","last_change":"2024-04-25T10:38:59.341204+0000","last_active":"2024-04-25T11:05:31.196396+0000","last_peered":"2024-04-25T11:05:31.196396+0000","last_clean":"2024-04-25T11:05:31.196396+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:31.196396+0000","last_undegraded":"2024-04-25T11:05:31.196396+0000","last_fullsized":"2024-04-25T11:05:31.196396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1816","reported_seq":1853,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.899089+0000","last_change":"2024-04-25T10:38:59.366859+0000","last_active":"2024-04-25T11:05:30.899089+0000","last_peered":"2024-04-25T11:05:30.899089+0000","last_clean":"2024-04-25T11:05:30.899089+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:30.899089+0000","last_undegraded":"2024-04-25T11:05:30.899089+0000","last_fullsized":"2024-04-25T11:05:30.899089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:30.551589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1835","reported_seq":1871,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.642640+0000","last_change":"2024-04-25T10:38:59.349805+0000","last_active":"2024-04-25T11:05:30.642640+0000","last_peered":"2024-04-25T11:05:30.642640+0000","last_clean":"2024-04-25T11:05:30.642640+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:30.642640+0000","last_undegraded":"2024-04-25T11:05:30.642640+0000","last_fullsized":"2024-04-25T11:05:30.642640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:51.202316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1953","reported_seq":1989,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.305604+0000","last_change":"2024-04-25T10:38:59.351129+0000","last_active":"2024-04-25T11:05:31.305604+0000","last_peered":"2024-04-25T11:05:31.305604+0000","last_clean":"2024-04-25T11:05:31.305604+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:31.305604+0000","last_undegraded":"2024-04-25T11:05:31.305604+0000","last_fullsized":"2024-04-25T11:05:31.305604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:12.308875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1930","reported_seq":1965,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.706161+0000","last_change":"2024-04-25T10:38:59.373735+0000","last_active":"2024-04-25T11:05:30.706161+0000","last_peered":"2024-04-25T11:05:30.706161+0000","last_clean":"2024-04-25T11:05:30.706161+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:30.706161+0000","last_undegraded":"2024-04-25T11:05:30.706161+0000","last_fullsized":"2024-04-25T11:05:30.706161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:49.929597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1891","reported_seq":1926,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.641484+0000","last_change":"2024-04-25T10:38:59.339320+0000","last_active":"2024-04-25T11:05:30.641484+0000","last_peered":"2024-04-25T11:05:30.641484+0000","last_clean":"2024-04-25T11:05:30.641484+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:30.641484+0000","last_undegraded":"2024-04-25T11:05:30.641484+0000","last_fullsized":"2024-04-25T11:05:30.641484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:06.757662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1855","reported_seq":1890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.695919+0000","last_change":"2024-04-25T10:38:59.355700+0000","last_active":"2024-04-25T11:05:30.695919+0000","last_peered":"2024-04-25T11:05:30.695919+0000","last_clean":"2024-04-25T11:05:30.695919+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:30.695919+0000","last_undegraded":"2024-04-25T11:05:30.695919+0000","last_fullsized":"2024-04-25T11:05:30.695919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:03.545221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1824","reported_seq":1860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.973690+0000","last_change":"2024-04-25T10:38:59.342424+0000","last_active":"2024-04-25T11:05:30.973690+0000","last_peered":"2024-04-25T11:05:30.973690+0000","last_clean":"2024-04-25T11:05:30.973690+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:30.973690+0000","last_undegraded":"2024-04-25T11:05:30.973690+0000","last_fullsized":"2024-04-25T11:05:30.973690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:40.746844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1920","reported_seq":1955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.670965+0000","last_change":"2024-04-25T10:38:59.363515+0000","last_active":"2024-04-25T11:05:30.670965+0000","last_peered":"2024-04-25T11:05:30.670965+0000","last_clean":"2024-04-25T11:05:30.670965+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:30.670965+0000","last_undegraded":"2024-04-25T11:05:30.670965+0000","last_fullsized":"2024-04-25T11:05:30.670965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:53.718621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1943","reported_seq":1982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.002950+0000","last_change":"2024-04-25T10:38:59.338398+0000","last_active":"2024-04-25T11:05:31.002950+0000","last_peered":"2024-04-25T11:05:31.002950+0000","last_clean":"2024-04-25T11:05:31.002950+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:31.002950+0000","last_undegraded":"2024-04-25T11:05:31.002950+0000","last_fullsized":"2024-04-25T11:05:31.002950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:02:27.771430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1984","reported_seq":2022,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.022057+0000","last_change":"2024-04-25T10:38:59.337286+0000","last_active":"2024-04-25T11:05:31.022057+0000","last_peered":"2024-04-25T11:05:31.022057+0000","last_clean":"2024-04-25T11:05:31.022057+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:31.022057+0000","last_undegraded":"2024-04-25T11:05:31.022057+0000","last_fullsized":"2024-04-25T11:05:31.022057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1848","reported_seq":1887,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:31.301908+0000","last_change":"2024-04-25T10:38:59.339977+0000","last_active":"2024-04-25T11:05:31.301908+0000","last_peered":"2024-04-25T11:05:31.301908+0000","last_clean":"2024-04-25T11:05:31.301908+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:31.301908+0000","last_undegraded":"2024-04-25T11:05:31.301908+0000","last_fullsized":"2024-04-25T11:05:31.301908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1830","reported_seq":1867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:29.848707+0000","last_change":"2024-04-25T10:38:59.375370+0000","last_active":"2024-04-25T11:05:29.848707+0000","last_peered":"2024-04-25T11:05:29.848707+0000","last_clean":"2024-04-25T11:05:29.848707+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:29.848707+0000","last_undegraded":"2024-04-25T11:05:29.848707+0000","last_fullsized":"2024-04-25T11:05:29.848707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:38:58.303818+0000","last_clean_scrub_stamp":"2024-04-25T10:38:58.303818+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:34.965773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151821,"num_write_kb":4126830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212967,"ondisk_log_size":212967,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121562,"ondisk_log_size":121562,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":242389115,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":2754,"num_read_kb":14599,"num_write":146439,"num_write_kb":1171334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304644096,"data_stored":484778230,"data_compressed":55811378,"data_compressed_allocated":82255872,"data_compressed_original":262545408,"omap_allocated":0,"internal_metadata":0},"log_size":143145,"ondisk_log_size":143145,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575174,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756724,"kb_used_data":35564,"kb_used_omap":1,"kb_used_meta":721150,"kb_avail":93615116,"statfs":{"total":96636764160,"available":95861878784,"internally_reserved":0,"allocated":36417536,"data_stored":55244212,"data_compressed":6002479,"data_compressed_allocated":9076736,"data_compressed_original":28102656,"omap_allocated":1590,"internal_metadata":738458058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575173,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806100,"kb_used_data":53068,"kb_used_omap":1,"kb_used_meta":753022,"kb_avail":93565740,"statfs":{"total":96636764160,"available":95811317760,"internally_reserved":0,"allocated":54341632,"data_stored":87322713,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":1594,"internal_metadata":771094982},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575173,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757208,"kb_used_data":36240,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93614632,"statfs":{"total":96636764160,"available":95861383168,"internally_reserved":0,"allocated":37109760,"data_stored":58847811,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575172,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":744504,"kb_used_data":41520,"kb_used_omap":1,"kb_used_meta":702974,"kb_avail":93627336,"statfs":{"total":96636764160,"available":95874392064,"internally_reserved":0,"allocated":42516480,"data_stored":67236154,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":1594,"internal_metadata":719845830},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575172,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":856040,"kb_used_data":62880,"kb_used_omap":1,"kb_used_meta":793150,"kb_avail":93515800,"statfs":{"total":96636764160,"available":95760179200,"internally_reserved":0,"allocated":64389120,"data_stored":103538562,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":1593,"internal_metadata":812186055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575173,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":483796,"kb_used_data":25100,"kb_used_omap":1,"kb_used_meta":458686,"kb_avail":93888044,"statfs":{"total":96636764160,"available":96141357056,"internally_reserved":0,"allocated":25702400,"data_stored":42070035,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":1595,"internal_metadata":469694917},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575173,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806148,"kb_used_data":21244,"kb_used_omap":1,"kb_used_meta":784894,"kb_avail":93565692,"statfs":{"total":96636764160,"available":95811268608,"internally_reserved":0,"allocated":21753856,"data_stored":34242954,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":1595,"internal_metadata":803731909},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575174,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569032,"kb_used_data":24384,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93802808,"statfs":{"total":96636764160,"available":96054075392,"internally_reserved":0,"allocated":24969216,"data_stored":38465941,"data_compressed":4403067,"data_compressed_allocated":6627328,"data_compressed_original":20320256,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21450752,"data_stored":34116777,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64086016,"data_stored":103412385,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109977,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":54038528,"data_stored":87196536,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527667,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:05:38.419 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.419 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.419 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.419 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.419 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.420 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.421 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.422 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.423 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T10:38:46.231102+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=46, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.424 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.425 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.426 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.427 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T10:38:57.294669+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.428 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.429 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.430 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T10:38:58.303818+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=38, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:38.431 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T11:05:58.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:05:58.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.597+0000 7fa761000640 1 Processor -- start 2024-04-25T11:05:58.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.597+0000 7fa761000640 1 -- start start 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa761000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa75c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa761000640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c0c9130 con 0x7fa75c070e10 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa761000640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75c071ad0 con 0x7fa75c1571f0 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa761000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c071db0 con 0x7fa75c0c4980 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa75a800640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa75c070e10 0x7fa75c167b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34758/0 (socket says 172.21.15.16:34758) 2024-04-25T11:05:58.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa75a800640 1 -- 172.21.15.16:0/1976463520 learned_addr learned my addr 172.21.15.16:0/1976463520 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa75c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873347889 0 0) 0x7fa75c0c9130 con 0x7fa75c070e10 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7400035c0 con 0x7fa75c070e10 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1403946373 0 0) 0x7fa7400035c0 con 0x7fa75c070e10 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 msgr2=0x7fa75c0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:58.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa75c0708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 >> v1:172.21.15.186:6789/0 conn(0x7fa75c1571f0 legacy=0x7fa75c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c160950 con 0x7fa75c070e10 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fa754001a50 con 0x7fa75c070e10 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 >> v1:172.21.15.16:6789/0 conn(0x7fa75c070e10 legacy=0x7fa75c167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa740003a80 0x7fa740003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa740004440 0x7fa740004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa7400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c071db0 con 0x7fa740004440 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa74000bb10 con 0x7fa740003a80 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa74000bcc0 con 0x7fa75c0c4980 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa740004440 0x7fa740004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa75a800640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa7400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa759e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa740003a80 0x7fa740003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 -- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 msgr2=0x7fa7400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:58.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c0c4980 0x7fa7400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 -- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa740003a80 msgr2=0x7fa740003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:05:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa740003a80 0x7fa740003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.601+0000 7fa753e00640 1 -- 172.21.15.16:0/1976463520 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7400035c0 con 0x7fa740004440 2024-04-25T11:05:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa753e00640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa740004440 0x7fa740004960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0737d0 tx=0x7fa74401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c041e8f84d479562 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7440b2070 con 0x7fa740004440 2024-04-25T11:05:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7440a5590 con 0x7fa740004440 2024-04-25T11:05:58.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa759400640 1 -- 172.21.15.16:0/1976463520 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744009730 con 0x7fa740004440 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 -- 172.21.15.16:0/1976463520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa740004440 msgr2=0x7fa740004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 --2- 172.21.15.16:0/1976463520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa740004440 0x7fa740004960 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0737d0 tx=0x7fa74401cab0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa75a800640 1 -- 172.21.15.16:0/1976463520 reap_dead start 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 -- 172.21.15.16:0/1976463520 shutdown_connections 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 -- 172.21.15.16:0/1976463520 >> 172.21.15.16:0/1976463520 conn(0x7fa75c0cdc80 msgr2=0x7fa75c0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 -- 172.21.15.16:0/1976463520 shutdown_connections 2024-04-25T11:05:58.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.605+0000 7fa761000640 1 -- 172.21.15.16:0/1976463520 wait complete. 2024-04-25T11:05:58.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 Processor -- start 2024-04-25T11:05:58.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 -- start start 2024-04-25T11:05:58.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c143190 0x7fa75c15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 0x7fa75c14c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c157600 con 0x7fa75c14ce00 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c160f10 con 0x7fa75c1435a0 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa761000640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa75c0c4d90 con 0x7fa75c143190 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa75a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa75a800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48948/0 (socket says 172.21.15.16:48948) 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa75a800640 1 -- 172.21.15.16:0/2749372383 learned_addr learned my addr 172.21.15.16:0/2749372383 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa759e00640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c143190 0x7fa75c15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.609+0000 7fa753e00640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 0x7fa75c14c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.612 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 -- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c143190 msgr2=0x7fa75c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c143190 0x7fa75c15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 -- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 msgr2=0x7fa75c14c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 0x7fa75c14c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 -- 172.21.15.16:0/2749372383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75c15fdf0 con 0x7fa75c14ce00 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa753e00640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 0x7fa75c14c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa75a800640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0735f0 tx=0x7fa754011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa754010040 con 0x7fa75c14ce00 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75401a070 con 0x7fa75c14ce00 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75400fb40 con 0x7fa75c14ce00 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c1600d0 con 0x7fa75c14ce00 2024-04-25T11:05:58.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c15e660 con 0x7fa75c14ce00 2024-04-25T11:05:58.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c050750 con 0x7fa75c14ce00 2024-04-25T11:05:58.614 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.613+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa75401f460 con 0x7fa75c14ce00 2024-04-25T11:05:58.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.617+0000 7fa752000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 0x7fa734071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:05:58.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.617+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa754092540 con 0x7fa75c14ce00 2024-04-25T11:05:58.615 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.617+0000 7fa759e00640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 0x7fa734071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:05:58.616 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.617+0000 7fa759e00640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 0x7fa734071ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000fc0 tx=0x7fa74c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:05:58.620 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.621+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa75405f070 con 0x7fa75c14ce00 2024-04-25T11:05:58.781 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.781+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa75c14a7e0 con 0x7fa73406f5a0 2024-04-25T11:05:58.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.805+0000 7fa752000640 1 -- 172.21.15.16:0/2749372383 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336764 (secure 0 0 0) 0x7fa75c14a7e0 con 0x7fa73406f5a0 2024-04-25T11:05:58.809 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:05:58.812 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 msgr2=0x7fa734071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 0x7fa734071ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000fc0 tx=0x7fa74c009040 comp rx=0 tx=0).stop 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 msgr2=0x7fa75c13db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0735f0 tx=0x7fa754011c20 comp rx=0 tx=0).stop 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 shutdown_connections 2024-04-25T11:05:58.813 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa73406f5a0 0x7fa734071ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa75c14ce00 0x7fa75c13db40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa75c1435a0 0x7fa75c14c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 --2- 172.21.15.16:0/2749372383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa75c143190 0x7fa75c15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 >> 172.21.15.16:0/2749372383 conn(0x7fa75c0cdc80 msgr2=0x7fa75c15ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 shutdown_connections 2024-04-25T11:05:58.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:05:58.809+0000 7fa761000640 1 -- 172.21.15.16:0/2749372383 wait complete. 2024-04-25T11:05:58.830 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":838,"stamp":"2024-04-25T11:05:58.369527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":242981134,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":7933,"num_read_kb":1313356,"num_write":299483,"num_write_kb":5299795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82340,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477862,"ondisk_log_size":477862,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5762920,"kb_used_data":300008,"kb_used_omap":12,"kb_used_meta":5462835,"kb_avail":749211800,"statfs":{"total":773094113280,"available":767192883200,"internally_reserved":0,"allocated":307208192,"data_stored":486971684,"data_compressed":55878340,"data_compressed_allocated":82345984,"data_compressed_original":263692288,"omap_allocated":12751,"internal_metadata":5593943601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006373"},"pg_stats":[{"pgid":"2.1f","version":"28'1887","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.708782+0000","last_change":"2024-04-25T11:05:36.708842+0000","last_active":"2024-04-25T11:05:36.708782+0000","last_peered":"2024-04-25T11:05:36.708782+0000","last_clean":"2024-04-25T11:05:36.708782+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:05:36.708782+0000","last_undegraded":"2024-04-25T11:05:36.708782+0000","last_fullsized":"2024-04-25T11:05:36.708782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1887","last_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_deep_scrub":"28'1887","last_deep_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.708689+0000","objects_scrubbed":4,"log_size":1887,"log_dups_size":0,"ondisk_log_size":1887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.316407+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1897,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1897","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.172603+0000","last_change":"2024-04-25T11:05:40.172634+0000","last_active":"2024-04-25T11:05:40.172603+0000","last_peered":"2024-04-25T11:05:40.172603+0000","last_clean":"2024-04-25T11:05:40.172603+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:40.172603+0000","last_undegraded":"2024-04-25T11:05:40.172603+0000","last_fullsized":"2024-04-25T11:05:40.172603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1897","last_scrub_stamp":"2024-04-25T11:05:40.172519+0000","last_deep_scrub":"28'1897","last_deep_scrub_stamp":"2024-04-25T11:05:40.172519+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.172519+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:12.026607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6392","reported_seq":6475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:54.256482+0000","last_change":"2024-04-25T11:05:54.256539+0000","last_active":"2024-04-25T11:05:54.256482+0000","last_peered":"2024-04-25T11:05:54.256482+0000","last_clean":"2024-04-25T11:05:54.256482+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:54.256482+0000","last_undegraded":"2024-04-25T11:05:54.256482+0000","last_fullsized":"2024-04-25T11:05:54.256482+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6392","last_scrub_stamp":"2024-04-25T11:05:54.256342+0000","last_deep_scrub":"28'6392","last_deep_scrub_stamp":"2024-04-25T11:05:54.256342+0000","last_clean_scrub_stamp":"2024-04-25T11:05:54.256342+0000","objects_scrubbed":0,"log_size":6292,"log_dups_size":0,"ondisk_log_size":6292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:20.583111+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4427,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4892","reported_seq":4941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.235672+0000","last_change":"2024-04-25T11:05:41.235728+0000","last_active":"2024-04-25T11:05:41.235672+0000","last_peered":"2024-04-25T11:05:41.235672+0000","last_clean":"2024-04-25T11:05:41.235672+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:41.235672+0000","last_undegraded":"2024-04-25T11:05:41.235672+0000","last_fullsized":"2024-04-25T11:05:41.235672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4892","last_scrub_stamp":"2024-04-25T11:05:41.235569+0000","last_deep_scrub":"28'4892","last_deep_scrub_stamp":"2024-04-25T11:05:41.235569+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.235569+0000","objects_scrubbed":1,"log_size":4892,"log_dups_size":0,"ondisk_log_size":4892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:40.476460+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1901","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.864480+0000","last_change":"2024-04-25T11:05:42.864511+0000","last_active":"2024-04-25T11:05:42.864480+0000","last_peered":"2024-04-25T11:05:42.864480+0000","last_clean":"2024-04-25T11:05:42.864480+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:42.864480+0000","last_undegraded":"2024-04-25T11:05:42.864480+0000","last_fullsized":"2024-04-25T11:05:42.864480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1901","last_scrub_stamp":"2024-04-25T11:05:42.864388+0000","last_deep_scrub":"28'1901","last_deep_scrub_stamp":"2024-04-25T11:05:42.864388+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.864388+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:13.563246+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6761","reported_seq":6899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.811028+0000","last_change":"2024-04-25T11:05:43.811028+0000","last_active":"2024-04-25T11:05:43.811028+0000","last_peered":"2024-04-25T11:05:43.811028+0000","last_clean":"2024-04-25T11:05:43.811028+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:43.811028+0000","last_undegraded":"2024-04-25T11:05:43.811028+0000","last_fullsized":"2024-04-25T11:05:43.811028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6761","last_scrub_stamp":"2024-04-25T11:05:43.810739+0000","last_deep_scrub":"28'6761","last_deep_scrub_stamp":"2024-04-25T11:05:43.810739+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.810739+0000","objects_scrubbed":0,"log_size":6761,"log_dups_size":0,"ondisk_log_size":6761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:22.675469+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4765,"num_write_kb":131182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7169","reported_seq":7215,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.523122+0000","last_change":"2024-04-25T11:05:44.523217+0000","last_active":"2024-04-25T11:05:44.523122+0000","last_peered":"2024-04-25T11:05:44.523122+0000","last_clean":"2024-04-25T11:05:44.523122+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:44.523122+0000","last_undegraded":"2024-04-25T11:05:44.523122+0000","last_fullsized":"2024-04-25T11:05:44.523122+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7169","last_scrub_stamp":"2024-04-25T11:05:44.522947+0000","last_deep_scrub":"28'7169","last_deep_scrub_stamp":"2024-04-25T11:05:44.522947+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.522947+0000","objects_scrubbed":5,"log_size":7069,"log_dups_size":0,"ondisk_log_size":7069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:09.779932+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7165,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1946","reported_seq":1991,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.212928+0000","last_change":"2024-04-25T11:05:50.213007+0000","last_active":"2024-04-25T11:05:50.212928+0000","last_peered":"2024-04-25T11:05:50.212928+0000","last_clean":"2024-04-25T11:05:50.212928+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:50.212928+0000","last_undegraded":"2024-04-25T11:05:50.212928+0000","last_fullsized":"2024-04-25T11:05:50.212928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1946","last_scrub_stamp":"2024-04-25T11:05:50.212611+0000","last_deep_scrub":"28'1946","last_deep_scrub_stamp":"2024-04-25T11:05:50.212611+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.212611+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:02.376742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6473","reported_seq":6698,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.869802+0000","last_change":"2024-04-25T11:05:50.869951+0000","last_active":"2024-04-25T11:05:50.869802+0000","last_peered":"2024-04-25T11:05:50.869802+0000","last_clean":"2024-04-25T11:05:50.869802+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:50.869802+0000","last_undegraded":"2024-04-25T11:05:50.869802+0000","last_fullsized":"2024-04-25T11:05:50.869802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6473","last_scrub_stamp":"2024-04-25T11:05:50.869452+0000","last_deep_scrub":"28'6473","last_deep_scrub_stamp":"2024-04-25T11:05:50.869452+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.869452+0000","objects_scrubbed":0,"log_size":6473,"log_dups_size":0,"ondisk_log_size":6473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:20.096745+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4436,"num_write_kb":116918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3806","reported_seq":3852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.481919+0000","last_change":"2024-04-25T11:05:45.481981+0000","last_active":"2024-04-25T11:05:45.481919+0000","last_peered":"2024-04-25T11:05:45.481919+0000","last_clean":"2024-04-25T11:05:45.481919+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:45.481919+0000","last_undegraded":"2024-04-25T11:05:45.481919+0000","last_fullsized":"2024-04-25T11:05:45.481919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3806","last_scrub_stamp":"2024-04-25T11:05:45.481780+0000","last_deep_scrub":"28'3806","last_deep_scrub_stamp":"2024-04-25T11:05:45.481780+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.481780+0000","objects_scrubbed":3,"log_size":3806,"log_dups_size":0,"ondisk_log_size":3806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.288384+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3806,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1896","reported_seq":1925,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.922846+0000","last_change":"2024-04-25T11:05:43.922878+0000","last_active":"2024-04-25T11:05:43.922846+0000","last_peered":"2024-04-25T11:05:43.922846+0000","last_clean":"2024-04-25T11:05:43.922846+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:43.922846+0000","last_undegraded":"2024-04-25T11:05:43.922846+0000","last_fullsized":"2024-04-25T11:05:43.922846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1896","last_scrub_stamp":"2024-04-25T11:05:43.922739+0000","last_deep_scrub":"28'1896","last_deep_scrub_stamp":"2024-04-25T11:05:43.922739+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.922739+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:21.044145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6632","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.784467+0000","last_change":"2024-04-25T11:05:42.784626+0000","last_active":"2024-04-25T11:05:42.784467+0000","last_peered":"2024-04-25T11:05:42.784467+0000","last_clean":"2024-04-25T11:05:42.784467+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:42.784467+0000","last_undegraded":"2024-04-25T11:05:42.784467+0000","last_fullsized":"2024-04-25T11:05:42.784467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6632","last_scrub_stamp":"2024-04-25T11:05:42.784084+0000","last_deep_scrub":"28'6632","last_deep_scrub_stamp":"2024-04-25T11:05:42.784084+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.784084+0000","objects_scrubbed":0,"log_size":6632,"log_dups_size":0,"ondisk_log_size":6632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:31.915980+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4668,"num_write_kb":122166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1916","reported_seq":1962,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.367442+0000","last_change":"2024-04-25T11:05:44.367602+0000","last_active":"2024-04-25T11:05:44.367442+0000","last_peered":"2024-04-25T11:05:44.367442+0000","last_clean":"2024-04-25T11:05:44.367442+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:44.367442+0000","last_undegraded":"2024-04-25T11:05:44.367442+0000","last_fullsized":"2024-04-25T11:05:44.367442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1916","last_scrub_stamp":"2024-04-25T11:05:44.367114+0000","last_deep_scrub":"28'1916","last_deep_scrub_stamp":"2024-04-25T11:05:44.367114+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.367114+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:27.315826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5509","reported_seq":5556,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.407372+0000","last_change":"2024-04-25T11:05:40.407495+0000","last_active":"2024-04-25T11:05:40.407372+0000","last_peered":"2024-04-25T11:05:40.407372+0000","last_clean":"2024-04-25T11:05:40.407372+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:05:40.407372+0000","last_undegraded":"2024-04-25T11:05:40.407372+0000","last_fullsized":"2024-04-25T11:05:40.407372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5509","last_scrub_stamp":"2024-04-25T11:05:40.407131+0000","last_deep_scrub":"28'5509","last_deep_scrub_stamp":"2024-04-25T11:05:40.407131+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.407131+0000","objects_scrubbed":4,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:27.014849+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5522,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3360,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6773","reported_seq":6860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.851077+0000","last_change":"2024-04-25T11:05:45.851162+0000","last_active":"2024-04-25T11:05:45.851077+0000","last_peered":"2024-04-25T11:05:45.851077+0000","last_clean":"2024-04-25T11:05:45.851077+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:45.851077+0000","last_undegraded":"2024-04-25T11:05:45.851077+0000","last_fullsized":"2024-04-25T11:05:45.851077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6773","last_scrub_stamp":"2024-04-25T11:05:45.850866+0000","last_deep_scrub":"28'6773","last_deep_scrub_stamp":"2024-04-25T11:05:45.850866+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.850866+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:17.704954+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4716,"num_write_kb":126930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1925","reported_seq":1971,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.088527+0000","last_change":"2024-04-25T11:05:47.088527+0000","last_active":"2024-04-25T11:05:47.088527+0000","last_peered":"2024-04-25T11:05:47.088527+0000","last_clean":"2024-04-25T11:05:47.088527+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:47.088527+0000","last_undegraded":"2024-04-25T11:05:47.088527+0000","last_fullsized":"2024-04-25T11:05:47.088527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1925","last_scrub_stamp":"2024-04-25T11:05:47.088276+0000","last_deep_scrub":"28'1925","last_deep_scrub_stamp":"2024-04-25T11:05:47.088276+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.088276+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:06.303672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4965","reported_seq":5014,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.365734+0000","last_change":"2024-04-25T11:05:37.365771+0000","last_active":"2024-04-25T11:05:37.365734+0000","last_peered":"2024-04-25T11:05:37.365734+0000","last_clean":"2024-04-25T11:05:37.365734+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:05:37.365734+0000","last_undegraded":"2024-04-25T11:05:37.365734+0000","last_fullsized":"2024-04-25T11:05:37.365734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4965","last_scrub_stamp":"2024-04-25T11:05:37.365658+0000","last_deep_scrub":"28'4965","last_deep_scrub_stamp":"2024-04-25T11:05:37.365658+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.365658+0000","objects_scrubbed":3,"log_size":4965,"log_dups_size":0,"ondisk_log_size":4965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.973376+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4961,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7064","reported_seq":7173,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.896196+0000","last_change":"2024-04-25T11:05:48.896248+0000","last_active":"2024-04-25T11:05:48.896196+0000","last_peered":"2024-04-25T11:05:48.896196+0000","last_clean":"2024-04-25T11:05:48.896196+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:48.896196+0000","last_undegraded":"2024-04-25T11:05:48.896196+0000","last_fullsized":"2024-04-25T11:05:48.896196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7064","last_scrub_stamp":"2024-04-25T11:05:48.896056+0000","last_deep_scrub":"28'7064","last_deep_scrub_stamp":"2024-04-25T11:05:48.896056+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.896056+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:29.361736+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5099,"num_write_kb":140880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1952","reported_seq":1998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.167738+0000","last_change":"2024-04-25T11:05:44.167779+0000","last_active":"2024-04-25T11:05:44.167738+0000","last_peered":"2024-04-25T11:05:44.167738+0000","last_clean":"2024-04-25T11:05:44.167738+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:44.167738+0000","last_undegraded":"2024-04-25T11:05:44.167738+0000","last_fullsized":"2024-04-25T11:05:44.167738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1952","last_scrub_stamp":"2024-04-25T11:05:44.167619+0000","last_deep_scrub":"28'1952","last_deep_scrub_stamp":"2024-04-25T11:05:44.167619+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.167619+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:25.308320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2280","reported_seq":2329,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.341424+0000","last_change":"2024-04-25T11:05:40.341460+0000","last_active":"2024-04-25T11:05:40.341424+0000","last_peered":"2024-04-25T11:05:40.341424+0000","last_clean":"2024-04-25T11:05:40.341424+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:05:40.341424+0000","last_undegraded":"2024-04-25T11:05:40.341424+0000","last_fullsized":"2024-04-25T11:05:40.341424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2280","last_scrub_stamp":"2024-04-25T11:05:40.341327+0000","last_deep_scrub":"28'2280","last_deep_scrub_stamp":"2024-04-25T11:05:40.341327+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.341327+0000","objects_scrubbed":2,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:20.045732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2286,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6674","reported_seq":6826,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.352915+0000","last_change":"2024-04-25T11:05:51.352950+0000","last_active":"2024-04-25T11:05:51.352915+0000","last_peered":"2024-04-25T11:05:51.352915+0000","last_clean":"2024-04-25T11:05:51.352915+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:51.352915+0000","last_undegraded":"2024-04-25T11:05:51.352915+0000","last_fullsized":"2024-04-25T11:05:51.352915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6674","last_scrub_stamp":"2024-04-25T11:05:51.352812+0000","last_deep_scrub":"28'6674","last_deep_scrub_stamp":"2024-04-25T11:05:51.352812+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.352812+0000","objects_scrubbed":0,"log_size":6674,"log_dups_size":0,"ondisk_log_size":6674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:15.741867+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4766,"num_write_kb":123430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1932","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.669966+0000","last_change":"2024-04-25T11:05:37.670160+0000","last_active":"2024-04-25T11:05:37.669966+0000","last_peered":"2024-04-25T11:05:37.669966+0000","last_clean":"2024-04-25T11:05:37.669966+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:37.669966+0000","last_undegraded":"2024-04-25T11:05:37.669966+0000","last_fullsized":"2024-04-25T11:05:37.669966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1932","last_scrub_stamp":"2024-04-25T11:05:37.669721+0000","last_deep_scrub":"28'1932","last_deep_scrub_stamp":"2024-04-25T11:05:37.669721+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.669721+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:08.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1621","reported_seq":1669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.402314+0000","last_change":"2024-04-25T11:05:43.402364+0000","last_active":"2024-04-25T11:05:43.402314+0000","last_peered":"2024-04-25T11:05:43.402314+0000","last_clean":"2024-04-25T11:05:43.402314+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:05:43.402314+0000","last_undegraded":"2024-04-25T11:05:43.402314+0000","last_fullsized":"2024-04-25T11:05:43.402314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1621","last_scrub_stamp":"2024-04-25T11:05:43.402209+0000","last_deep_scrub":"28'1621","last_deep_scrub_stamp":"2024-04-25T11:05:43.402209+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.402209+0000","objects_scrubbed":1,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:40.679251+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1631,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7421","reported_seq":7531,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.893463+0000","last_change":"2024-04-25T11:05:46.893615+0000","last_active":"2024-04-25T11:05:46.893463+0000","last_peered":"2024-04-25T11:05:46.893463+0000","last_clean":"2024-04-25T11:05:46.893463+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:46.893463+0000","last_undegraded":"2024-04-25T11:05:46.893463+0000","last_fullsized":"2024-04-25T11:05:46.893463+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7421","last_scrub_stamp":"2024-04-25T11:05:46.893135+0000","last_deep_scrub":"28'7421","last_deep_scrub_stamp":"2024-04-25T11:05:46.893135+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.893135+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:46.134027+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5371,"num_write_kb":119270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1896","reported_seq":1942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.770328+0000","last_change":"2024-04-25T11:05:39.770356+0000","last_active":"2024-04-25T11:05:39.770328+0000","last_peered":"2024-04-25T11:05:39.770328+0000","last_clean":"2024-04-25T11:05:39.770328+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:39.770328+0000","last_undegraded":"2024-04-25T11:05:39.770328+0000","last_fullsized":"2024-04-25T11:05:39.770328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1896","last_scrub_stamp":"2024-04-25T11:05:39.770241+0000","last_deep_scrub":"28'1896","last_deep_scrub_stamp":"2024-04-25T11:05:39.770241+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.770241+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:37.047283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2482","reported_seq":2530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.481672+0000","last_change":"2024-04-25T11:05:41.481835+0000","last_active":"2024-04-25T11:05:41.481672+0000","last_peered":"2024-04-25T11:05:41.481672+0000","last_clean":"2024-04-25T11:05:41.481672+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:05:41.481672+0000","last_undegraded":"2024-04-25T11:05:41.481672+0000","last_fullsized":"2024-04-25T11:05:41.481672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2482","last_scrub_stamp":"2024-04-25T11:05:41.481329+0000","last_deep_scrub":"28'2482","last_deep_scrub_stamp":"2024-04-25T11:05:41.481329+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.481329+0000","objects_scrubbed":3,"log_size":2482,"log_dups_size":0,"ondisk_log_size":2482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.345851+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2505,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6601","reported_seq":6715,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.887537+0000","last_change":"2024-04-25T11:05:49.887613+0000","last_active":"2024-04-25T11:05:49.887537+0000","last_peered":"2024-04-25T11:05:49.887537+0000","last_clean":"2024-04-25T11:05:49.887537+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:49.887537+0000","last_undegraded":"2024-04-25T11:05:49.887537+0000","last_fullsized":"2024-04-25T11:05:49.887537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6601","last_scrub_stamp":"2024-04-25T11:05:49.887312+0000","last_deep_scrub":"28'6601","last_deep_scrub_stamp":"2024-04-25T11:05:49.887312+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.887312+0000","objects_scrubbed":0,"log_size":6601,"log_dups_size":0,"ondisk_log_size":6601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:31.028013+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4630,"num_write_kb":127804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1852","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.145896+0000","last_change":"2024-04-25T11:05:49.145970+0000","last_active":"2024-04-25T11:05:49.145896+0000","last_peered":"2024-04-25T11:05:49.145896+0000","last_clean":"2024-04-25T11:05:49.145896+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:49.145896+0000","last_undegraded":"2024-04-25T11:05:49.145896+0000","last_fullsized":"2024-04-25T11:05:49.145896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1852","last_scrub_stamp":"2024-04-25T11:05:49.145778+0000","last_deep_scrub":"28'1852","last_deep_scrub_stamp":"2024-04-25T11:05:49.145778+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.145778+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:41.179629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4071","reported_seq":4193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.491783+0000","last_change":"2024-04-25T11:05:41.491822+0000","last_active":"2024-04-25T11:05:41.491783+0000","last_peered":"2024-04-25T11:05:41.491783+0000","last_clean":"2024-04-25T11:05:41.491783+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:41.491783+0000","last_undegraded":"2024-04-25T11:05:41.491783+0000","last_fullsized":"2024-04-25T11:05:41.491783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4071","last_scrub_stamp":"2024-04-25T11:05:41.491697+0000","last_deep_scrub":"28'4071","last_deep_scrub_stamp":"2024-04-25T11:05:41.491697+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.491697+0000","objects_scrubbed":3,"log_size":4071,"log_dups_size":0,"ondisk_log_size":4071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:06.748682+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":561401,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":596,"num_write":6804,"num_write_kb":36821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6499","reported_seq":6717,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.255200+0000","last_change":"2024-04-25T11:05:52.255237+0000","last_active":"2024-04-25T11:05:52.255200+0000","last_peered":"2024-04-25T11:05:52.255200+0000","last_clean":"2024-04-25T11:05:52.255200+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:52.255200+0000","last_undegraded":"2024-04-25T11:05:52.255200+0000","last_fullsized":"2024-04-25T11:05:52.255200+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6499","last_scrub_stamp":"2024-04-25T11:05:52.255098+0000","last_deep_scrub":"28'6499","last_deep_scrub_stamp":"2024-04-25T11:05:52.255098+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.255098+0000","objects_scrubbed":0,"log_size":6299,"log_dups_size":0,"ondisk_log_size":6299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:43.207415+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4488,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1924","reported_seq":1971,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.396294+0000","last_change":"2024-04-25T11:05:43.396326+0000","last_active":"2024-04-25T11:05:43.396294+0000","last_peered":"2024-04-25T11:05:43.396294+0000","last_clean":"2024-04-25T11:05:43.396294+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:43.396294+0000","last_undegraded":"2024-04-25T11:05:43.396294+0000","last_fullsized":"2024-04-25T11:05:43.396294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1924","last_scrub_stamp":"2024-04-25T11:05:43.396213+0000","last_deep_scrub":"28'1924","last_deep_scrub_stamp":"2024-04-25T11:05:43.396213+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.396213+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:14.095071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4562","reported_seq":4610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.373705+0000","last_change":"2024-04-25T11:05:42.373788+0000","last_active":"2024-04-25T11:05:42.373705+0000","last_peered":"2024-04-25T11:05:42.373705+0000","last_clean":"2024-04-25T11:05:42.373705+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:05:42.373705+0000","last_undegraded":"2024-04-25T11:05:42.373705+0000","last_fullsized":"2024-04-25T11:05:42.373705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4562","last_scrub_stamp":"2024-04-25T11:05:42.373509+0000","last_deep_scrub":"28'4562","last_deep_scrub_stamp":"2024-04-25T11:05:42.373509+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.373509+0000","objects_scrubbed":3,"log_size":4562,"log_dups_size":0,"ondisk_log_size":4562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:25.322220+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4570,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9000,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7286","reported_seq":7545,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.816353+0000","last_change":"2024-04-25T11:05:50.816386+0000","last_active":"2024-04-25T11:05:50.816353+0000","last_peered":"2024-04-25T11:05:50.816353+0000","last_clean":"2024-04-25T11:05:50.816353+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:50.816353+0000","last_undegraded":"2024-04-25T11:05:50.816353+0000","last_fullsized":"2024-04-25T11:05:50.816353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7286","last_scrub_stamp":"2024-04-25T11:05:50.816237+0000","last_deep_scrub":"28'7286","last_deep_scrub_stamp":"2024-04-25T11:05:50.816237+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.816237+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:10.031633+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5277,"num_write_kb":159191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1892","reported_seq":1939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.160130+0000","last_change":"2024-04-25T11:05:43.160208+0000","last_active":"2024-04-25T11:05:43.160130+0000","last_peered":"2024-04-25T11:05:43.160130+0000","last_clean":"2024-04-25T11:05:43.160130+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:43.160130+0000","last_undegraded":"2024-04-25T11:05:43.160130+0000","last_fullsized":"2024-04-25T11:05:43.160130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1892","last_scrub_stamp":"2024-04-25T11:05:43.159892+0000","last_deep_scrub":"28'1892","last_deep_scrub_stamp":"2024-04-25T11:05:43.159892+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.159892+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:08.416877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4326","reported_seq":4375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.324346+0000","last_change":"2024-04-25T11:05:38.324384+0000","last_active":"2024-04-25T11:05:38.324346+0000","last_peered":"2024-04-25T11:05:38.324346+0000","last_clean":"2024-04-25T11:05:38.324346+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:38.324346+0000","last_undegraded":"2024-04-25T11:05:38.324346+0000","last_fullsized":"2024-04-25T11:05:38.324346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4326","last_scrub_stamp":"2024-04-25T11:05:38.324263+0000","last_deep_scrub":"28'4326","last_deep_scrub_stamp":"2024-04-25T11:05:38.324263+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.324263+0000","objects_scrubbed":2,"log_size":4326,"log_dups_size":0,"ondisk_log_size":4326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:46.878327+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4330,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7463","reported_seq":7765,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.394759+0000","last_change":"2024-04-25T11:05:50.394791+0000","last_active":"2024-04-25T11:05:50.394759+0000","last_peered":"2024-04-25T11:05:50.394759+0000","last_clean":"2024-04-25T11:05:50.394759+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:50.394759+0000","last_undegraded":"2024-04-25T11:05:50.394759+0000","last_fullsized":"2024-04-25T11:05:50.394759+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7463","last_scrub_stamp":"2024-04-25T11:05:50.394641+0000","last_deep_scrub":"28'7463","last_deep_scrub_stamp":"2024-04-25T11:05:50.394641+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.394641+0000","objects_scrubbed":0,"log_size":7363,"log_dups_size":0,"ondisk_log_size":7363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:06.229632+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5445,"num_write_kb":157562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1915","reported_seq":1962,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.725971+0000","last_change":"2024-04-25T11:05:40.726055+0000","last_active":"2024-04-25T11:05:40.725971+0000","last_peered":"2024-04-25T11:05:40.725971+0000","last_clean":"2024-04-25T11:05:40.725971+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:40.725971+0000","last_undegraded":"2024-04-25T11:05:40.725971+0000","last_fullsized":"2024-04-25T11:05:40.725971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1915","last_scrub_stamp":"2024-04-25T11:05:40.725725+0000","last_deep_scrub":"28'1915","last_deep_scrub_stamp":"2024-04-25T11:05:40.725725+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.725725+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:23.674436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5572","reported_seq":5621,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.092056+0000","last_change":"2024-04-25T11:05:39.092119+0000","last_active":"2024-04-25T11:05:39.092056+0000","last_peered":"2024-04-25T11:05:39.092056+0000","last_clean":"2024-04-25T11:05:39.092056+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:05:39.092056+0000","last_undegraded":"2024-04-25T11:05:39.092056+0000","last_fullsized":"2024-04-25T11:05:39.092056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5572","last_scrub_stamp":"2024-04-25T11:05:39.091939+0000","last_deep_scrub":"28'5572","last_deep_scrub_stamp":"2024-04-25T11:05:39.091939+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.091939+0000","objects_scrubbed":1,"log_size":5572,"log_dups_size":0,"ondisk_log_size":5572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:40.976082+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5576,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6966","reported_seq":7048,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.363779+0000","last_change":"2024-04-25T11:05:49.363839+0000","last_active":"2024-04-25T11:05:49.363779+0000","last_peered":"2024-04-25T11:05:49.363779+0000","last_clean":"2024-04-25T11:05:49.363779+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:49.363779+0000","last_undegraded":"2024-04-25T11:05:49.363779+0000","last_fullsized":"2024-04-25T11:05:49.363779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6966","last_scrub_stamp":"2024-04-25T11:05:49.363634+0000","last_deep_scrub":"28'6966","last_deep_scrub_stamp":"2024-04-25T11:05:49.363634+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.363634+0000","objects_scrubbed":0,"log_size":6966,"log_dups_size":0,"ondisk_log_size":6966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:18.590927+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4982,"num_write_kb":146653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1914","reported_seq":1962,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.393679+0000","last_change":"2024-04-25T11:05:44.393745+0000","last_active":"2024-04-25T11:05:44.393679+0000","last_peered":"2024-04-25T11:05:44.393679+0000","last_clean":"2024-04-25T11:05:44.393679+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:44.393679+0000","last_undegraded":"2024-04-25T11:05:44.393679+0000","last_fullsized":"2024-04-25T11:05:44.393679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1914","last_scrub_stamp":"2024-04-25T11:05:44.393549+0000","last_deep_scrub":"28'1914","last_deep_scrub_stamp":"2024-04-25T11:05:44.393549+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.393549+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:38.833835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6031","reported_seq":7476,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.862292+0000","last_change":"2024-04-25T11:05:36.862337+0000","last_active":"2024-04-25T11:05:36.862292+0000","last_peered":"2024-04-25T11:05:36.862292+0000","last_clean":"2024-04-25T11:05:36.862292+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:05:36.862292+0000","last_undegraded":"2024-04-25T11:05:36.862292+0000","last_fullsized":"2024-04-25T11:05:36.862292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6031","last_scrub_stamp":"2024-04-25T11:05:36.862180+0000","last_deep_scrub":"28'6031","last_deep_scrub_stamp":"2024-04-25T11:05:36.862180+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.862180+0000","objects_scrubbed":5,"log_size":6031,"log_dups_size":0,"ondisk_log_size":6031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:58.349320+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6041,"num_write_kb":43946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6549","reported_seq":7099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.399007+0000","last_change":"2024-04-25T11:05:47.399058+0000","last_active":"2024-04-25T11:05:47.399007+0000","last_peered":"2024-04-25T11:05:47.399007+0000","last_clean":"2024-04-25T11:05:47.399007+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:47.399007+0000","last_undegraded":"2024-04-25T11:05:47.399007+0000","last_fullsized":"2024-04-25T11:05:47.399007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6549","last_scrub_stamp":"2024-04-25T11:05:47.398882+0000","last_deep_scrub":"28'6549","last_deep_scrub_stamp":"2024-04-25T11:05:47.398882+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.398882+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.864562+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4580,"num_write_kb":125268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1830","reported_seq":1876,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.812302+0000","last_change":"2024-04-25T11:05:44.812339+0000","last_active":"2024-04-25T11:05:44.812302+0000","last_peered":"2024-04-25T11:05:44.812302+0000","last_clean":"2024-04-25T11:05:44.812302+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:44.812302+0000","last_undegraded":"2024-04-25T11:05:44.812302+0000","last_fullsized":"2024-04-25T11:05:44.812302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1830","last_scrub_stamp":"2024-04-25T11:05:44.812192+0000","last_deep_scrub":"28'1830","last_deep_scrub_stamp":"2024-04-25T11:05:44.812192+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.812192+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:44.053083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5534","reported_seq":5583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.418571+0000","last_change":"2024-04-25T11:05:41.418724+0000","last_active":"2024-04-25T11:05:41.418571+0000","last_peered":"2024-04-25T11:05:41.418571+0000","last_clean":"2024-04-25T11:05:41.418571+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:41.418571+0000","last_undegraded":"2024-04-25T11:05:41.418571+0000","last_fullsized":"2024-04-25T11:05:41.418571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5534","last_scrub_stamp":"2024-04-25T11:05:41.418338+0000","last_deep_scrub":"28'5534","last_deep_scrub_stamp":"2024-04-25T11:05:41.418338+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.418338+0000","objects_scrubbed":1,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.972402+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5542,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6641","reported_seq":6770,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.894978+0000","last_change":"2024-04-25T11:05:47.895015+0000","last_active":"2024-04-25T11:05:47.894978+0000","last_peered":"2024-04-25T11:05:47.894978+0000","last_clean":"2024-04-25T11:05:47.894978+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:47.894978+0000","last_undegraded":"2024-04-25T11:05:47.894978+0000","last_fullsized":"2024-04-25T11:05:47.894978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6641","last_scrub_stamp":"2024-04-25T11:05:47.894854+0000","last_deep_scrub":"28'6641","last_deep_scrub_stamp":"2024-04-25T11:05:47.894854+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.894854+0000","objects_scrubbed":0,"log_size":6641,"log_dups_size":0,"ondisk_log_size":6641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:29.035555+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4590,"num_write_kb":120036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1945","reported_seq":1991,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.175878+0000","last_change":"2024-04-25T11:05:38.175969+0000","last_active":"2024-04-25T11:05:38.175878+0000","last_peered":"2024-04-25T11:05:38.175878+0000","last_clean":"2024-04-25T11:05:38.175878+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:38.175878+0000","last_undegraded":"2024-04-25T11:05:38.175878+0000","last_fullsized":"2024-04-25T11:05:38.175878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1945","last_scrub_stamp":"2024-04-25T11:05:38.175727+0000","last_deep_scrub":"28'1945","last_deep_scrub_stamp":"2024-04-25T11:05:38.175727+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.175727+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:01.982331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3775","reported_seq":3824,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.070348+0000","last_change":"2024-04-25T11:05:38.070500+0000","last_active":"2024-04-25T11:05:38.070348+0000","last_peered":"2024-04-25T11:05:38.070348+0000","last_clean":"2024-04-25T11:05:38.070348+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:05:38.070348+0000","last_undegraded":"2024-04-25T11:05:38.070348+0000","last_fullsized":"2024-04-25T11:05:38.070348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3775","last_scrub_stamp":"2024-04-25T11:05:38.070107+0000","last_deep_scrub":"28'3775","last_deep_scrub_stamp":"2024-04-25T11:05:38.070107+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.070107+0000","objects_scrubbed":4,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:39.934629+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3784,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":147,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.366922+0000","last_change":"2024-04-25T11:05:39.367005+0000","last_active":"2024-04-25T11:05:39.366922+0000","last_peered":"2024-04-25T11:05:39.366922+0000","last_clean":"2024-04-25T11:05:39.366922+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:05:39.366922+0000","last_undegraded":"2024-04-25T11:05:39.366922+0000","last_fullsized":"2024-04-25T11:05:39.366922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-04-25T11:05:39.366733+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-04-25T11:05:39.366733+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.366733+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:10.390163+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6746","reported_seq":6890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.339345+0000","last_change":"2024-04-25T11:05:51.339497+0000","last_active":"2024-04-25T11:05:51.339345+0000","last_peered":"2024-04-25T11:05:51.339345+0000","last_clean":"2024-04-25T11:05:51.339345+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:51.339345+0000","last_undegraded":"2024-04-25T11:05:51.339345+0000","last_fullsized":"2024-04-25T11:05:51.339345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6746","last_scrub_stamp":"2024-04-25T11:05:51.339006+0000","last_deep_scrub":"28'6746","last_deep_scrub_stamp":"2024-04-25T11:05:51.339006+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.339006+0000","objects_scrubbed":0,"log_size":6746,"log_dups_size":0,"ondisk_log_size":6746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:50.812802+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4798,"num_write_kb":130135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1910","reported_seq":1955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.356831+0000","last_change":"2024-04-25T11:05:46.356925+0000","last_active":"2024-04-25T11:05:46.356831+0000","last_peered":"2024-04-25T11:05:46.356831+0000","last_clean":"2024-04-25T11:05:46.356831+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:46.356831+0000","last_undegraded":"2024-04-25T11:05:46.356831+0000","last_fullsized":"2024-04-25T11:05:46.356831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1910","last_scrub_stamp":"2024-04-25T11:05:46.356614+0000","last_deep_scrub":"28'1910","last_deep_scrub_stamp":"2024-04-25T11:05:46.356614+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.356614+0000","objects_scrubbed":0,"log_size":1910,"log_dups_size":0,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:17.055472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4308","reported_seq":4356,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.831160+0000","last_change":"2024-04-25T11:05:38.831197+0000","last_active":"2024-04-25T11:05:38.831160+0000","last_peered":"2024-04-25T11:05:38.831160+0000","last_clean":"2024-04-25T11:05:38.831160+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:05:38.831160+0000","last_undegraded":"2024-04-25T11:05:38.831160+0000","last_fullsized":"2024-04-25T11:05:38.831160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4308","last_scrub_stamp":"2024-04-25T11:05:38.831084+0000","last_deep_scrub":"28'4308","last_deep_scrub_stamp":"2024-04-25T11:05:38.831084+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.831084+0000","objects_scrubbed":4,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:30.665233+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4304,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6656","reported_seq":6889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.290774+0000","last_change":"2024-04-25T11:05:50.290855+0000","last_active":"2024-04-25T11:05:50.290774+0000","last_peered":"2024-04-25T11:05:50.290774+0000","last_clean":"2024-04-25T11:05:50.290774+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:50.290774+0000","last_undegraded":"2024-04-25T11:05:50.290774+0000","last_fullsized":"2024-04-25T11:05:50.290774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6656","last_scrub_stamp":"2024-04-25T11:05:50.290555+0000","last_deep_scrub":"28'6656","last_deep_scrub_stamp":"2024-04-25T11:05:50.290555+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.290555+0000","objects_scrubbed":0,"log_size":6656,"log_dups_size":0,"ondisk_log_size":6656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:49.531446+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4615,"num_write_kb":121061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1900","reported_seq":1946,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.971235+0000","last_change":"2024-04-25T11:05:36.971342+0000","last_active":"2024-04-25T11:05:36.971235+0000","last_peered":"2024-04-25T11:05:36.971235+0000","last_clean":"2024-04-25T11:05:36.971235+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:36.971235+0000","last_undegraded":"2024-04-25T11:05:36.971235+0000","last_fullsized":"2024-04-25T11:05:36.971235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1900","last_scrub_stamp":"2024-04-25T11:05:36.971020+0000","last_deep_scrub":"28'1900","last_deep_scrub_stamp":"2024-04-25T11:05:36.971020+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.971020+0000","objects_scrubbed":0,"log_size":1900,"log_dups_size":0,"ondisk_log_size":1900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:14.092426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5445","reported_seq":5493,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.340154+0000","last_change":"2024-04-25T11:05:39.340195+0000","last_active":"2024-04-25T11:05:39.340154+0000","last_peered":"2024-04-25T11:05:39.340154+0000","last_clean":"2024-04-25T11:05:39.340154+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:05:39.340154+0000","last_undegraded":"2024-04-25T11:05:39.340154+0000","last_fullsized":"2024-04-25T11:05:39.340154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5445","last_scrub_stamp":"2024-04-25T11:05:39.340069+0000","last_deep_scrub":"28'5445","last_deep_scrub_stamp":"2024-04-25T11:05:39.340069+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.340069+0000","objects_scrubbed":5,"log_size":5445,"log_dups_size":0,"ondisk_log_size":5445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:22.288780+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5441,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6687","reported_seq":7012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.828403+0000","last_change":"2024-04-25T11:05:45.828456+0000","last_active":"2024-04-25T11:05:45.828403+0000","last_peered":"2024-04-25T11:05:45.828403+0000","last_clean":"2024-04-25T11:05:45.828403+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:45.828403+0000","last_undegraded":"2024-04-25T11:05:45.828403+0000","last_fullsized":"2024-04-25T11:05:45.828403+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6687","last_scrub_stamp":"2024-04-25T11:05:45.828228+0000","last_deep_scrub":"28'6687","last_deep_scrub_stamp":"2024-04-25T11:05:45.828228+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.828228+0000","objects_scrubbed":0,"log_size":6687,"log_dups_size":0,"ondisk_log_size":6687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:45.302024+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4636,"num_write_kb":135921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1836","reported_seq":1866,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.386553+0000","last_change":"2024-04-25T11:05:52.386638+0000","last_active":"2024-04-25T11:05:52.386553+0000","last_peered":"2024-04-25T11:05:52.386553+0000","last_clean":"2024-04-25T11:05:52.386553+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:52.386553+0000","last_undegraded":"2024-04-25T11:05:52.386553+0000","last_fullsized":"2024-04-25T11:05:52.386553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1836","last_scrub_stamp":"2024-04-25T11:05:52.386445+0000","last_deep_scrub":"28'1836","last_deep_scrub_stamp":"2024-04-25T11:05:52.386445+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.386445+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:54.550532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4839","reported_seq":4887,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.889156+0000","last_change":"2024-04-25T11:05:37.889205+0000","last_active":"2024-04-25T11:05:37.889156+0000","last_peered":"2024-04-25T11:05:37.889156+0000","last_clean":"2024-04-25T11:05:37.889156+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:37.889156+0000","last_undegraded":"2024-04-25T11:05:37.889156+0000","last_fullsized":"2024-04-25T11:05:37.889156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4839","last_scrub_stamp":"2024-04-25T11:05:37.889073+0000","last_deep_scrub":"28'4839","last_deep_scrub_stamp":"2024-04-25T11:05:37.889073+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.889073+0000","objects_scrubbed":6,"log_size":4839,"log_dups_size":0,"ondisk_log_size":4839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:19.476740+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4839,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7079","reported_seq":7155,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.261851+0000","last_change":"2024-04-25T11:05:53.261901+0000","last_active":"2024-04-25T11:05:53.261851+0000","last_peered":"2024-04-25T11:05:53.261851+0000","last_clean":"2024-04-25T11:05:53.261851+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:53.261851+0000","last_undegraded":"2024-04-25T11:05:53.261851+0000","last_fullsized":"2024-04-25T11:05:53.261851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7079","last_scrub_stamp":"2024-04-25T11:05:53.261709+0000","last_deep_scrub":"28'7079","last_deep_scrub_stamp":"2024-04-25T11:05:53.261709+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.261709+0000","objects_scrubbed":0,"log_size":7079,"log_dups_size":0,"ondisk_log_size":7079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:02.793308+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5048,"num_write_kb":119873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1923","reported_seq":1968,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.319285+0000","last_change":"2024-04-25T11:05:50.319417+0000","last_active":"2024-04-25T11:05:50.319285+0000","last_peered":"2024-04-25T11:05:50.319285+0000","last_clean":"2024-04-25T11:05:50.319285+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:50.319285+0000","last_undegraded":"2024-04-25T11:05:50.319285+0000","last_fullsized":"2024-04-25T11:05:50.319285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1923","last_scrub_stamp":"2024-04-25T11:05:50.318969+0000","last_deep_scrub":"28'1923","last_deep_scrub_stamp":"2024-04-25T11:05:50.318969+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.318969+0000","objects_scrubbed":0,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:45.552992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3726","reported_seq":3774,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.815694+0000","last_change":"2024-04-25T11:05:36.815859+0000","last_active":"2024-04-25T11:05:36.815694+0000","last_peered":"2024-04-25T11:05:36.815694+0000","last_clean":"2024-04-25T11:05:36.815694+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:36.815694+0000","last_undegraded":"2024-04-25T11:05:36.815694+0000","last_fullsized":"2024-04-25T11:05:36.815694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3726","last_scrub_stamp":"2024-04-25T11:05:36.815341+0000","last_deep_scrub":"28'3726","last_deep_scrub_stamp":"2024-04-25T11:05:36.815341+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.815341+0000","objects_scrubbed":6,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:13.936747+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3720,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6596","reported_seq":6729,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.842128+0000","last_change":"2024-04-25T11:05:44.842239+0000","last_active":"2024-04-25T11:05:44.842128+0000","last_peered":"2024-04-25T11:05:44.842128+0000","last_clean":"2024-04-25T11:05:44.842128+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:44.842128+0000","last_undegraded":"2024-04-25T11:05:44.842128+0000","last_fullsized":"2024-04-25T11:05:44.842128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6596","last_scrub_stamp":"2024-04-25T11:05:44.841905+0000","last_deep_scrub":"28'6596","last_deep_scrub_stamp":"2024-04-25T11:05:44.841905+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.841905+0000","objects_scrubbed":0,"log_size":6596,"log_dups_size":0,"ondisk_log_size":6596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:15.540763+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4504,"num_write_kb":119124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1943","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.341465+0000","last_change":"2024-04-25T11:05:51.341537+0000","last_active":"2024-04-25T11:05:51.341465+0000","last_peered":"2024-04-25T11:05:51.341465+0000","last_clean":"2024-04-25T11:05:51.341465+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:51.341465+0000","last_undegraded":"2024-04-25T11:05:51.341465+0000","last_fullsized":"2024-04-25T11:05:51.341465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:51.341275+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:51.341275+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.341275+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:32.481976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2230","reported_seq":2278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.867322+0000","last_change":"2024-04-25T11:05:35.867375+0000","last_active":"2024-04-25T11:05:35.867322+0000","last_peered":"2024-04-25T11:05:35.867322+0000","last_clean":"2024-04-25T11:05:35.867322+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:05:35.867322+0000","last_undegraded":"2024-04-25T11:05:35.867322+0000","last_fullsized":"2024-04-25T11:05:35.867322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2230","last_scrub_stamp":"2024-04-25T11:05:35.867248+0000","last_deep_scrub":"28'2230","last_deep_scrub_stamp":"2024-04-25T11:05:35.867248+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.867248+0000","objects_scrubbed":9,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:20.088328+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2236,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6569","reported_seq":6829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.866569+0000","last_change":"2024-04-25T11:05:46.866604+0000","last_active":"2024-04-25T11:05:46.866569+0000","last_peered":"2024-04-25T11:05:46.866569+0000","last_clean":"2024-04-25T11:05:46.866569+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:46.866569+0000","last_undegraded":"2024-04-25T11:05:46.866569+0000","last_fullsized":"2024-04-25T11:05:46.866569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6569","last_scrub_stamp":"2024-04-25T11:05:46.866448+0000","last_deep_scrub":"28'6569","last_deep_scrub_stamp":"2024-04-25T11:05:46.866448+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.866448+0000","objects_scrubbed":0,"log_size":6569,"log_dups_size":0,"ondisk_log_size":6569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:42.100471+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4527,"num_write_kb":127214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1852","reported_seq":1897,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.422870+0000","last_change":"2024-04-25T11:05:42.422918+0000","last_active":"2024-04-25T11:05:42.422870+0000","last_peered":"2024-04-25T11:05:42.422870+0000","last_clean":"2024-04-25T11:05:42.422870+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:42.422870+0000","last_undegraded":"2024-04-25T11:05:42.422870+0000","last_fullsized":"2024-04-25T11:05:42.422870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1852","last_scrub_stamp":"2024-04-25T11:05:42.422756+0000","last_deep_scrub":"28'1852","last_deep_scrub_stamp":"2024-04-25T11:05:42.422756+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.422756+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:44.306900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1714","reported_seq":1761,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.545836+0000","last_change":"2024-04-25T11:05:37.545918+0000","last_active":"2024-04-25T11:05:37.545836+0000","last_peered":"2024-04-25T11:05:37.545836+0000","last_clean":"2024-04-25T11:05:37.545836+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:05:37.545836+0000","last_undegraded":"2024-04-25T11:05:37.545836+0000","last_fullsized":"2024-04-25T11:05:37.545836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1714","last_scrub_stamp":"2024-04-25T11:05:37.545588+0000","last_deep_scrub":"28'1714","last_deep_scrub_stamp":"2024-04-25T11:05:37.545588+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.545588+0000","objects_scrubbed":3,"log_size":1714,"log_dups_size":0,"ondisk_log_size":1714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:37.422156+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195291,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1716,"num_write_kb":21294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6817","reported_seq":6910,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.615673+0000","last_change":"2024-04-25T10:39:04.085662+0000","last_active":"2024-04-25T11:05:35.615673+0000","last_peered":"2024-04-25T11:05:35.615673+0000","last_clean":"2024-04-25T11:05:35.615673+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:35.615673+0000","last_undegraded":"2024-04-25T11:05:35.615673+0000","last_fullsized":"2024-04-25T11:05:35.615673+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6313,"log_dups_size":0,"ondisk_log_size":6313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4812,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1911","reported_seq":1956,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.357055+0000","last_change":"2024-04-25T11:05:52.357101+0000","last_active":"2024-04-25T11:05:52.357055+0000","last_peered":"2024-04-25T11:05:52.357055+0000","last_clean":"2024-04-25T11:05:52.357055+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:52.357055+0000","last_undegraded":"2024-04-25T11:05:52.357055+0000","last_fullsized":"2024-04-25T11:05:52.357055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1911","last_scrub_stamp":"2024-04-25T11:05:52.356951+0000","last_deep_scrub":"28'1911","last_deep_scrub_stamp":"2024-04-25T11:05:52.356951+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.356951+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:04.521082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1359","reported_seq":1407,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.120216+0000","last_change":"2024-04-25T11:05:40.120271+0000","last_active":"2024-04-25T11:05:40.120216+0000","last_peered":"2024-04-25T11:05:40.120216+0000","last_clean":"2024-04-25T11:05:40.120216+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:05:40.120216+0000","last_undegraded":"2024-04-25T11:05:40.120216+0000","last_fullsized":"2024-04-25T11:05:40.120216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1359","last_scrub_stamp":"2024-04-25T11:05:40.120108+0000","last_deep_scrub":"28'1359","last_deep_scrub_stamp":"2024-04-25T11:05:40.120108+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.120108+0000","objects_scrubbed":3,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:48.674172+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1362,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6439","reported_seq":6654,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:30.926877+0000","last_change":"2024-04-25T10:39:39.093855+0000","last_active":"2024-04-25T11:05:30.926877+0000","last_peered":"2024-04-25T11:05:30.926877+0000","last_clean":"2024-04-25T11:05:30.926877+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:30.926877+0000","last_undegraded":"2024-04-25T11:05:30.926877+0000","last_fullsized":"2024-04-25T11:05:30.926877+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:39:02.351595+0000","last_clean_scrub_stamp":"2024-04-25T10:39:02.351595+0000","objects_scrubbed":0,"log_size":6339,"log_dups_size":0,"ondisk_log_size":6339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4468,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1931","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.847931+0000","last_change":"2024-04-25T11:05:41.847962+0000","last_active":"2024-04-25T11:05:41.847931+0000","last_peered":"2024-04-25T11:05:41.847931+0000","last_clean":"2024-04-25T11:05:41.847931+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:41.847931+0000","last_undegraded":"2024-04-25T11:05:41.847931+0000","last_fullsized":"2024-04-25T11:05:41.847931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1931","last_scrub_stamp":"2024-04-25T11:05:41.847820+0000","last_deep_scrub":"28'1931","last_deep_scrub_stamp":"2024-04-25T11:05:41.847820+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.847820+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:05.654424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3878","reported_seq":3925,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.785709+0000","last_change":"2024-04-25T11:05:35.785763+0000","last_active":"2024-04-25T11:05:35.785709+0000","last_peered":"2024-04-25T11:05:35.785709+0000","last_clean":"2024-04-25T11:05:35.785709+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:05:35.785709+0000","last_undegraded":"2024-04-25T11:05:35.785709+0000","last_fullsized":"2024-04-25T11:05:35.785709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3878","last_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_deep_scrub":"28'3878","last_deep_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.785612+0000","objects_scrubbed":7,"log_size":3878,"log_dups_size":0,"ondisk_log_size":3878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:06.809043+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3882,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6424","reported_seq":6629,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.239782+0000","last_change":"2024-04-25T11:05:52.239915+0000","last_active":"2024-04-25T11:05:52.239782+0000","last_peered":"2024-04-25T11:05:52.239782+0000","last_clean":"2024-04-25T11:05:52.239782+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:52.239782+0000","last_undegraded":"2024-04-25T11:05:52.239782+0000","last_fullsized":"2024-04-25T11:05:52.239782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6424","last_scrub_stamp":"2024-04-25T11:05:52.239567+0000","last_deep_scrub":"28'6424","last_deep_scrub_stamp":"2024-04-25T11:05:52.239567+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.239567+0000","objects_scrubbed":0,"log_size":6424,"log_dups_size":0,"ondisk_log_size":6424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:11.454963+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4474,"num_write_kb":118590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1853","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.369411+0000","last_change":"2024-04-25T11:05:38.369496+0000","last_active":"2024-04-25T11:05:38.369411+0000","last_peered":"2024-04-25T11:05:38.369411+0000","last_clean":"2024-04-25T11:05:38.369411+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:38.369411+0000","last_undegraded":"2024-04-25T11:05:38.369411+0000","last_fullsized":"2024-04-25T11:05:38.369411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1853","last_scrub_stamp":"2024-04-25T11:05:38.369177+0000","last_deep_scrub":"28'1853","last_deep_scrub_stamp":"2024-04-25T11:05:38.369177+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.369177+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:24.275875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7375","reported_seq":8047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.226689+0000","last_change":"2024-04-25T11:05:39.614502+0000","last_active":"2024-04-25T11:05:42.226689+0000","last_peered":"2024-04-25T11:05:42.226689+0000","last_clean":"2024-04-25T11:05:42.226689+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:42.226689+0000","last_undegraded":"2024-04-25T11:05:42.226689+0000","last_fullsized":"2024-04-25T11:05:42.226689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7373","last_scrub_stamp":"2024-04-25T11:05:39.614026+0000","last_deep_scrub":"28'7373","last_deep_scrub_stamp":"2024-04-25T11:05:39.614026+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.614026+0000","objects_scrubbed":11,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.520724+0000","scrub_duration":163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19526845,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7375,"num_write_kb":55482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6574","reported_seq":6647,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.387896+0000","last_change":"2024-04-25T11:05:48.387935+0000","last_active":"2024-04-25T11:05:48.387896+0000","last_peered":"2024-04-25T11:05:48.387896+0000","last_clean":"2024-04-25T11:05:48.387896+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:48.387896+0000","last_undegraded":"2024-04-25T11:05:48.387896+0000","last_fullsized":"2024-04-25T11:05:48.387896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6574","last_scrub_stamp":"2024-04-25T11:05:48.387747+0000","last_deep_scrub":"28'6574","last_deep_scrub_stamp":"2024-04-25T11:05:48.387747+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.387747+0000","objects_scrubbed":0,"log_size":6574,"log_dups_size":0,"ondisk_log_size":6574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:29.528448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4583,"num_write_kb":116164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1899","reported_seq":1945,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.694748+0000","last_change":"2024-04-25T11:05:39.694827+0000","last_active":"2024-04-25T11:05:39.694748+0000","last_peered":"2024-04-25T11:05:39.694748+0000","last_clean":"2024-04-25T11:05:39.694748+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:39.694748+0000","last_undegraded":"2024-04-25T11:05:39.694748+0000","last_fullsized":"2024-04-25T11:05:39.694748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1899","last_scrub_stamp":"2024-04-25T11:05:39.694533+0000","last_deep_scrub":"28'1899","last_deep_scrub_stamp":"2024-04-25T11:05:39.694533+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.694533+0000","objects_scrubbed":0,"log_size":1899,"log_dups_size":0,"ondisk_log_size":1899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:39.458321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5171","reported_seq":5219,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.484411+0000","last_change":"2024-04-25T11:05:42.484464+0000","last_active":"2024-04-25T11:05:42.484411+0000","last_peered":"2024-04-25T11:05:42.484411+0000","last_clean":"2024-04-25T11:05:42.484411+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:42.484411+0000","last_undegraded":"2024-04-25T11:05:42.484411+0000","last_fullsized":"2024-04-25T11:05:42.484411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5171","last_scrub_stamp":"2024-04-25T11:05:42.484325+0000","last_deep_scrub":"28'5171","last_deep_scrub_stamp":"2024-04-25T11:05:42.484325+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.484325+0000","objects_scrubbed":7,"log_size":5171,"log_dups_size":0,"ondisk_log_size":5171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:06.290929+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5172,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6464","reported_seq":6530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.913363+0000","last_change":"2024-04-25T11:05:47.913439+0000","last_active":"2024-04-25T11:05:47.913363+0000","last_peered":"2024-04-25T11:05:47.913363+0000","last_clean":"2024-04-25T11:05:47.913363+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:47.913363+0000","last_undegraded":"2024-04-25T11:05:47.913363+0000","last_fullsized":"2024-04-25T11:05:47.913363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6464","last_scrub_stamp":"2024-04-25T11:05:47.913145+0000","last_deep_scrub":"28'6464","last_deep_scrub_stamp":"2024-04-25T11:05:47.913145+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.913145+0000","objects_scrubbed":0,"log_size":6464,"log_dups_size":0,"ondisk_log_size":6464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.386941+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4399,"num_write_kb":121932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1922","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:34.673075+0000","last_change":"2024-04-25T11:05:34.673075+0000","last_active":"2024-04-25T11:05:34.673075+0000","last_peered":"2024-04-25T11:05:34.673075+0000","last_clean":"2024-04-25T11:05:34.673075+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:34.673075+0000","last_undegraded":"2024-04-25T11:05:34.673075+0000","last_fullsized":"2024-04-25T11:05:34.673075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1922","last_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_deep_scrub":"28'1922","last_deep_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_clean_scrub_stamp":"2024-04-25T11:05:34.672946+0000","objects_scrubbed":0,"log_size":1922,"log_dups_size":0,"ondisk_log_size":1922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:11.794352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5289","reported_seq":5337,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.179637+0000","last_change":"2024-04-25T11:05:41.179695+0000","last_active":"2024-04-25T11:05:41.179637+0000","last_peered":"2024-04-25T11:05:41.179637+0000","last_clean":"2024-04-25T11:05:41.179637+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:05:41.179637+0000","last_undegraded":"2024-04-25T11:05:41.179637+0000","last_fullsized":"2024-04-25T11:05:41.179637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5289","last_scrub_stamp":"2024-04-25T11:05:41.179528+0000","last_deep_scrub":"28'5289","last_deep_scrub_stamp":"2024-04-25T11:05:41.179528+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.179528+0000","objects_scrubbed":3,"log_size":5289,"log_dups_size":0,"ondisk_log_size":5289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:08.824304+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5291,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6505","reported_seq":6850,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.219006+0000","last_change":"2024-04-25T11:05:50.219066+0000","last_active":"2024-04-25T11:05:50.219006+0000","last_peered":"2024-04-25T11:05:50.219006+0000","last_clean":"2024-04-25T11:05:50.219006+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:50.219006+0000","last_undegraded":"2024-04-25T11:05:50.219006+0000","last_fullsized":"2024-04-25T11:05:50.219006+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6505","last_scrub_stamp":"2024-04-25T11:05:50.218877+0000","last_deep_scrub":"28'6505","last_deep_scrub_stamp":"2024-04-25T11:05:50.218877+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.218877+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:31.384604+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4587,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1886","reported_seq":1915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.878484+0000","last_change":"2024-04-25T11:05:42.878514+0000","last_active":"2024-04-25T11:05:42.878484+0000","last_peered":"2024-04-25T11:05:42.878484+0000","last_clean":"2024-04-25T11:05:42.878484+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:42.878484+0000","last_undegraded":"2024-04-25T11:05:42.878484+0000","last_fullsized":"2024-04-25T11:05:42.878484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1886","last_scrub_stamp":"2024-04-25T11:05:42.878389+0000","last_deep_scrub":"28'1886","last_deep_scrub_stamp":"2024-04-25T11:05:42.878389+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.878389+0000","objects_scrubbed":0,"log_size":1886,"log_dups_size":0,"ondisk_log_size":1886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:05.057275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4615","reported_seq":5275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.498832+0000","last_change":"2024-04-25T11:05:40.498903+0000","last_active":"2024-04-25T11:05:40.498832+0000","last_peered":"2024-04-25T11:05:40.498832+0000","last_clean":"2024-04-25T11:05:40.498832+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:40.498832+0000","last_undegraded":"2024-04-25T11:05:40.498832+0000","last_fullsized":"2024-04-25T11:05:40.498832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4615","last_scrub_stamp":"2024-04-25T11:05:40.498675+0000","last_deep_scrub":"28'4615","last_deep_scrub_stamp":"2024-04-25T11:05:40.498675+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.498675+0000","objects_scrubbed":4,"log_size":4615,"log_dups_size":0,"ondisk_log_size":4615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:34.524405+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4610,"num_write_kb":39070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6806","reported_seq":7252,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.229370+0000","last_change":"2024-04-25T11:05:53.229457+0000","last_active":"2024-04-25T11:05:53.229370+0000","last_peered":"2024-04-25T11:05:53.229370+0000","last_clean":"2024-04-25T11:05:53.229370+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:53.229370+0000","last_undegraded":"2024-04-25T11:05:53.229370+0000","last_fullsized":"2024-04-25T11:05:53.229370+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6806","last_scrub_stamp":"2024-04-25T11:05:53.229202+0000","last_deep_scrub":"28'6806","last_deep_scrub_stamp":"2024-04-25T11:05:53.229202+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.229202+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:19.958742+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4777,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6723","reported_seq":6868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.851402+0000","last_change":"2024-04-25T11:05:48.851456+0000","last_active":"2024-04-25T11:05:48.851402+0000","last_peered":"2024-04-25T11:05:48.851402+0000","last_clean":"2024-04-25T11:05:48.851402+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:48.851402+0000","last_undegraded":"2024-04-25T11:05:48.851402+0000","last_fullsized":"2024-04-25T11:05:48.851402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6723","last_scrub_stamp":"2024-04-25T11:05:48.851274+0000","last_deep_scrub":"28'6723","last_deep_scrub_stamp":"2024-04-25T11:05:48.851274+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.851274+0000","objects_scrubbed":0,"log_size":6723,"log_dups_size":0,"ondisk_log_size":6723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:01.015405+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4788,"num_write_kb":128894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1850","reported_seq":1896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.275167+0000","last_change":"2024-04-25T11:05:35.275167+0000","last_active":"2024-04-25T11:05:35.275167+0000","last_peered":"2024-04-25T11:05:35.275167+0000","last_clean":"2024-04-25T11:05:35.275167+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:35.275167+0000","last_undegraded":"2024-04-25T11:05:35.275167+0000","last_fullsized":"2024-04-25T11:05:35.275167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1850","last_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_deep_scrub":"28'1850","last_deep_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.275042+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:12.396448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7632","reported_seq":7680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.194761+0000","last_change":"2024-04-25T11:05:42.194863+0000","last_active":"2024-04-25T11:05:42.194761+0000","last_peered":"2024-04-25T11:05:42.194761+0000","last_clean":"2024-04-25T11:05:42.194761+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:42.194761+0000","last_undegraded":"2024-04-25T11:05:42.194761+0000","last_fullsized":"2024-04-25T11:05:42.194761+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7632","last_scrub_stamp":"2024-04-25T11:05:42.194499+0000","last_deep_scrub":"28'7632","last_deep_scrub_stamp":"2024-04-25T11:05:42.194499+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.194499+0000","objects_scrubbed":2,"log_size":7332,"log_dups_size":0,"ondisk_log_size":7332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.471542+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6433","reported_seq":6772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.255933+0000","last_change":"2024-04-25T11:05:49.256012+0000","last_active":"2024-04-25T11:05:49.255933+0000","last_peered":"2024-04-25T11:05:49.255933+0000","last_clean":"2024-04-25T11:05:49.255933+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:49.255933+0000","last_undegraded":"2024-04-25T11:05:49.255933+0000","last_fullsized":"2024-04-25T11:05:49.255933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6433","last_scrub_stamp":"2024-04-25T11:05:49.255715+0000","last_deep_scrub":"28'6433","last_deep_scrub_stamp":"2024-04-25T11:05:49.255715+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.255715+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:21.109802+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4458,"num_write_kb":135113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1942","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.129060+0000","last_change":"2024-04-25T11:05:45.129093+0000","last_active":"2024-04-25T11:05:45.129060+0000","last_peered":"2024-04-25T11:05:45.129060+0000","last_clean":"2024-04-25T11:05:45.129060+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:45.129060+0000","last_undegraded":"2024-04-25T11:05:45.129060+0000","last_fullsized":"2024-04-25T11:05:45.129060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1942","last_scrub_stamp":"2024-04-25T11:05:45.128948+0000","last_deep_scrub":"28'1942","last_deep_scrub_stamp":"2024-04-25T11:05:45.128948+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.128948+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:57.293080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3994","reported_seq":4041,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.258819+0000","last_change":"2024-04-25T11:05:42.258866+0000","last_active":"2024-04-25T11:05:42.258819+0000","last_peered":"2024-04-25T11:05:42.258819+0000","last_clean":"2024-04-25T11:05:42.258819+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:05:42.258819+0000","last_undegraded":"2024-04-25T11:05:42.258819+0000","last_fullsized":"2024-04-25T11:05:42.258819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3994","last_scrub_stamp":"2024-04-25T11:05:42.258687+0000","last_deep_scrub":"28'3994","last_deep_scrub_stamp":"2024-04-25T11:05:42.258687+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.258687+0000","objects_scrubbed":5,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:41.732483+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7623","reported_seq":7669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.646123+0000","last_change":"2024-04-25T11:05:38.646226+0000","last_active":"2024-04-25T11:05:38.646123+0000","last_peered":"2024-04-25T11:05:38.646123+0000","last_clean":"2024-04-25T11:05:38.646123+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:05:38.646123+0000","last_undegraded":"2024-04-25T11:05:38.646123+0000","last_fullsized":"2024-04-25T11:05:38.646123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7623","last_scrub_stamp":"2024-04-25T11:05:38.646006+0000","last_deep_scrub":"28'7623","last_deep_scrub_stamp":"2024-04-25T11:05:38.646006+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.646006+0000","objects_scrubbed":8,"log_size":7623,"log_dups_size":0,"ondisk_log_size":7623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:19.637891+0000","scrub_duration":167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7611,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1866","reported_seq":1910,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.805172+0000","last_change":"2024-04-25T11:05:43.805208+0000","last_active":"2024-04-25T11:05:43.805172+0000","last_peered":"2024-04-25T11:05:43.805172+0000","last_clean":"2024-04-25T11:05:43.805172+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:43.805172+0000","last_undegraded":"2024-04-25T11:05:43.805172+0000","last_fullsized":"2024-04-25T11:05:43.805172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1866","last_scrub_stamp":"2024-04-25T11:05:43.805055+0000","last_deep_scrub":"28'1866","last_deep_scrub_stamp":"2024-04-25T11:05:43.805055+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.805055+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:15.659142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6829","reported_seq":6922,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.888014+0000","last_change":"2024-04-25T11:05:41.888050+0000","last_active":"2024-04-25T11:05:41.888014+0000","last_peered":"2024-04-25T11:05:41.888014+0000","last_clean":"2024-04-25T11:05:41.888014+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:41.888014+0000","last_undegraded":"2024-04-25T11:05:41.888014+0000","last_fullsized":"2024-04-25T11:05:41.888014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6829","last_scrub_stamp":"2024-04-25T11:05:41.887885+0000","last_deep_scrub":"28'6829","last_deep_scrub_stamp":"2024-04-25T11:05:41.887885+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.887885+0000","objects_scrubbed":0,"log_size":6829,"log_dups_size":0,"ondisk_log_size":6829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:55.669713+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4770,"num_write_kb":143218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5979","reported_seq":6025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.322908+0000","last_change":"2024-04-25T11:05:43.322957+0000","last_active":"2024-04-25T11:05:43.322908+0000","last_peered":"2024-04-25T11:05:43.322908+0000","last_clean":"2024-04-25T11:05:43.322908+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:43.322908+0000","last_undegraded":"2024-04-25T11:05:43.322908+0000","last_fullsized":"2024-04-25T11:05:43.322908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5979","last_scrub_stamp":"2024-04-25T11:05:43.322821+0000","last_deep_scrub":"28'5979","last_deep_scrub_stamp":"2024-04-25T11:05:43.322821+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.322821+0000","objects_scrubbed":8,"log_size":5979,"log_dups_size":0,"ondisk_log_size":5979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:38.556844+0000","scrub_duration":183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1925","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.716295+0000","last_change":"2024-04-25T11:05:38.716370+0000","last_active":"2024-04-25T11:05:38.716295+0000","last_peered":"2024-04-25T11:05:38.716295+0000","last_clean":"2024-04-25T11:05:38.716295+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:38.716295+0000","last_undegraded":"2024-04-25T11:05:38.716295+0000","last_fullsized":"2024-04-25T11:05:38.716295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1925","last_scrub_stamp":"2024-04-25T11:05:38.716093+0000","last_deep_scrub":"28'1925","last_deep_scrub_stamp":"2024-04-25T11:05:38.716093+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.716093+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:25.323811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7364","reported_seq":7926,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.196776+0000","last_change":"2024-04-25T11:05:51.196814+0000","last_active":"2024-04-25T11:05:51.196776+0000","last_peered":"2024-04-25T11:05:51.196776+0000","last_clean":"2024-04-25T11:05:51.196776+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:51.196776+0000","last_undegraded":"2024-04-25T11:05:51.196776+0000","last_fullsized":"2024-04-25T11:05:51.196776+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7364","last_scrub_stamp":"2024-04-25T11:05:51.196643+0000","last_deep_scrub":"28'7364","last_deep_scrub_stamp":"2024-04-25T11:05:51.196643+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.196643+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:29.502502+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5337,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1843","reported_seq":1889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.305805+0000","last_change":"2024-04-25T11:05:46.305876+0000","last_active":"2024-04-25T11:05:46.305805+0000","last_peered":"2024-04-25T11:05:46.305805+0000","last_clean":"2024-04-25T11:05:46.305805+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:46.305805+0000","last_undegraded":"2024-04-25T11:05:46.305805+0000","last_fullsized":"2024-04-25T11:05:46.305805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1843","last_scrub_stamp":"2024-04-25T11:05:46.305599+0000","last_deep_scrub":"28'1843","last_deep_scrub_stamp":"2024-04-25T11:05:46.305599+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.305599+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:11.562584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1947","reported_seq":1994,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.777131+0000","last_change":"2024-04-25T11:05:39.777161+0000","last_active":"2024-04-25T11:05:39.777131+0000","last_peered":"2024-04-25T11:05:39.777131+0000","last_clean":"2024-04-25T11:05:39.777131+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:39.777131+0000","last_undegraded":"2024-04-25T11:05:39.777131+0000","last_fullsized":"2024-04-25T11:05:39.777131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1947","last_scrub_stamp":"2024-04-25T11:05:39.776963+0000","last_deep_scrub":"28'1947","last_deep_scrub_stamp":"2024-04-25T11:05:39.776963+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.776963+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:40.932212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1853","reported_seq":1900,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.164438+0000","last_change":"2024-04-25T11:05:45.164486+0000","last_active":"2024-04-25T11:05:45.164438+0000","last_peered":"2024-04-25T11:05:45.164438+0000","last_clean":"2024-04-25T11:05:45.164438+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:45.164438+0000","last_undegraded":"2024-04-25T11:05:45.164438+0000","last_fullsized":"2024-04-25T11:05:45.164438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1853","last_scrub_stamp":"2024-04-25T11:05:45.164325+0000","last_deep_scrub":"28'1853","last_deep_scrub_stamp":"2024-04-25T11:05:45.164325+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.164325+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:06.921534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1943","reported_seq":1994,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.801735+0000","last_change":"2024-04-25T11:05:49.801767+0000","last_active":"2024-04-25T11:05:49.801735+0000","last_peered":"2024-04-25T11:05:49.801735+0000","last_clean":"2024-04-25T11:05:49.801735+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:49.801735+0000","last_undegraded":"2024-04-25T11:05:49.801735+0000","last_fullsized":"2024-04-25T11:05:49.801735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:49.801619+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:49.801619+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.801619+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:05.636610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1942","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.168932+0000","last_change":"2024-04-25T11:05:39.168964+0000","last_active":"2024-04-25T11:05:39.168932+0000","last_peered":"2024-04-25T11:05:39.168932+0000","last_clean":"2024-04-25T11:05:39.168932+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:39.168932+0000","last_undegraded":"2024-04-25T11:05:39.168932+0000","last_fullsized":"2024-04-25T11:05:39.168932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1942","last_scrub_stamp":"2024-04-25T11:05:39.168824+0000","last_deep_scrub":"28'1942","last_deep_scrub_stamp":"2024-04-25T11:05:39.168824+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.168824+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:09.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1847","reported_seq":1894,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.335562+0000","last_change":"2024-04-25T11:05:36.335608+0000","last_active":"2024-04-25T11:05:36.335562+0000","last_peered":"2024-04-25T11:05:36.335562+0000","last_clean":"2024-04-25T11:05:36.335562+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:36.335562+0000","last_undegraded":"2024-04-25T11:05:36.335562+0000","last_fullsized":"2024-04-25T11:05:36.335562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1847","last_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_deep_scrub":"28'1847","last_deep_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.335456+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.358886+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1948","reported_seq":1994,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.268707+0000","last_change":"2024-04-25T11:05:47.268780+0000","last_active":"2024-04-25T11:05:47.268707+0000","last_peered":"2024-04-25T11:05:47.268707+0000","last_clean":"2024-04-25T11:05:47.268707+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:47.268707+0000","last_undegraded":"2024-04-25T11:05:47.268707+0000","last_fullsized":"2024-04-25T11:05:47.268707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1948","last_scrub_stamp":"2024-04-25T11:05:47.268506+0000","last_deep_scrub":"28'1948","last_deep_scrub_stamp":"2024-04-25T11:05:47.268506+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.268506+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:11.075110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1915","reported_seq":1961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.112884+0000","last_change":"2024-04-25T11:05:36.112913+0000","last_active":"2024-04-25T11:05:36.112884+0000","last_peered":"2024-04-25T11:05:36.112884+0000","last_clean":"2024-04-25T11:05:36.112884+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:36.112884+0000","last_undegraded":"2024-04-25T11:05:36.112884+0000","last_fullsized":"2024-04-25T11:05:36.112884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1915","last_scrub_stamp":"2024-04-25T11:05:36.112788+0000","last_deep_scrub":"28'1915","last_deep_scrub_stamp":"2024-04-25T11:05:36.112788+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.112788+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:33.389830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1873","reported_seq":1920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.129386+0000","last_change":"2024-04-25T11:05:46.129462+0000","last_active":"2024-04-25T11:05:46.129386+0000","last_peered":"2024-04-25T11:05:46.129386+0000","last_clean":"2024-04-25T11:05:46.129386+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:46.129386+0000","last_undegraded":"2024-04-25T11:05:46.129386+0000","last_fullsized":"2024-04-25T11:05:46.129386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1873","last_scrub_stamp":"2024-04-25T11:05:46.129186+0000","last_deep_scrub":"28'1873","last_deep_scrub_stamp":"2024-04-25T11:05:46.129186+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.129186+0000","objects_scrubbed":0,"log_size":1873,"log_dups_size":0,"ondisk_log_size":1873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:45.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1913","reported_seq":1959,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.142038+0000","last_change":"2024-04-25T11:05:37.142038+0000","last_active":"2024-04-25T11:05:37.142038+0000","last_peered":"2024-04-25T11:05:37.142038+0000","last_clean":"2024-04-25T11:05:37.142038+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:37.142038+0000","last_undegraded":"2024-04-25T11:05:37.142038+0000","last_fullsized":"2024-04-25T11:05:37.142038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1913","last_scrub_stamp":"2024-04-25T11:05:37.141855+0000","last_deep_scrub":"28'1913","last_deep_scrub_stamp":"2024-04-25T11:05:37.141855+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.141855+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:02.398839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1928","reported_seq":1974,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.187715+0000","last_change":"2024-04-25T11:05:49.187760+0000","last_active":"2024-04-25T11:05:49.187715+0000","last_peered":"2024-04-25T11:05:49.187715+0000","last_clean":"2024-04-25T11:05:49.187715+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:49.187715+0000","last_undegraded":"2024-04-25T11:05:49.187715+0000","last_fullsized":"2024-04-25T11:05:49.187715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1928","last_scrub_stamp":"2024-04-25T11:05:49.187600+0000","last_deep_scrub":"28'1928","last_deep_scrub_stamp":"2024-04-25T11:05:49.187600+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.187600+0000","objects_scrubbed":0,"log_size":1928,"log_dups_size":0,"ondisk_log_size":1928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:30.328300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1930","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.801173+0000","last_change":"2024-04-25T11:05:40.801232+0000","last_active":"2024-04-25T11:05:40.801173+0000","last_peered":"2024-04-25T11:05:40.801173+0000","last_clean":"2024-04-25T11:05:40.801173+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:40.801173+0000","last_undegraded":"2024-04-25T11:05:40.801173+0000","last_fullsized":"2024-04-25T11:05:40.801173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1930","last_scrub_stamp":"2024-04-25T11:05:40.801053+0000","last_deep_scrub":"28'1930","last_deep_scrub_stamp":"2024-04-25T11:05:40.801053+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.801053+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:06.058037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1903","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.262847+0000","last_change":"2024-04-25T11:05:48.262941+0000","last_active":"2024-04-25T11:05:48.262847+0000","last_peered":"2024-04-25T11:05:48.262847+0000","last_clean":"2024-04-25T11:05:48.262847+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:48.262847+0000","last_undegraded":"2024-04-25T11:05:48.262847+0000","last_fullsized":"2024-04-25T11:05:48.262847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1903","last_scrub_stamp":"2024-04-25T11:05:48.262651+0000","last_deep_scrub":"28'1903","last_deep_scrub_stamp":"2024-04-25T11:05:48.262651+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.262651+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:18.961509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1959","reported_seq":2004,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.340815+0000","last_change":"2024-04-25T11:05:48.340965+0000","last_active":"2024-04-25T11:05:48.340815+0000","last_peered":"2024-04-25T11:05:48.340815+0000","last_clean":"2024-04-25T11:05:48.340815+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:48.340815+0000","last_undegraded":"2024-04-25T11:05:48.340815+0000","last_fullsized":"2024-04-25T11:05:48.340815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-04-25T11:05:48.340572+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-04-25T11:05:48.340572+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.340572+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:47.581463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1860","reported_seq":1906,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.823169+0000","last_change":"2024-04-25T11:05:40.823201+0000","last_active":"2024-04-25T11:05:40.823169+0000","last_peered":"2024-04-25T11:05:40.823169+0000","last_clean":"2024-04-25T11:05:40.823169+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:40.823169+0000","last_undegraded":"2024-04-25T11:05:40.823169+0000","last_fullsized":"2024-04-25T11:05:40.823169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1860","last_scrub_stamp":"2024-04-25T11:05:40.823065+0000","last_deep_scrub":"28'1860","last_deep_scrub_stamp":"2024-04-25T11:05:40.823065+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.823065+0000","objects_scrubbed":0,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:45.623650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1907","reported_seq":1953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.268918+0000","last_change":"2024-04-25T11:05:51.268995+0000","last_active":"2024-04-25T11:05:51.268918+0000","last_peered":"2024-04-25T11:05:51.268918+0000","last_clean":"2024-04-25T11:05:51.268918+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:51.268918+0000","last_undegraded":"2024-04-25T11:05:51.268918+0000","last_fullsized":"2024-04-25T11:05:51.268918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1907","last_scrub_stamp":"2024-04-25T11:05:51.268697+0000","last_deep_scrub":"28'1907","last_deep_scrub_stamp":"2024-04-25T11:05:51.268697+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.268697+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.103688+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1838","reported_seq":1884,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.117595+0000","last_change":"2024-04-25T11:05:47.117675+0000","last_active":"2024-04-25T11:05:47.117595+0000","last_peered":"2024-04-25T11:05:47.117595+0000","last_clean":"2024-04-25T11:05:47.117595+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:47.117595+0000","last_undegraded":"2024-04-25T11:05:47.117595+0000","last_fullsized":"2024-04-25T11:05:47.117595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1838","last_scrub_stamp":"2024-04-25T11:05:47.117364+0000","last_deep_scrub":"28'1838","last_deep_scrub_stamp":"2024-04-25T11:05:47.117364+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.117364+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:46.591160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1959","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.391401+0000","last_change":"2024-04-25T11:05:46.391437+0000","last_active":"2024-04-25T11:05:46.391401+0000","last_peered":"2024-04-25T11:05:46.391401+0000","last_clean":"2024-04-25T11:05:46.391401+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:46.391401+0000","last_undegraded":"2024-04-25T11:05:46.391401+0000","last_fullsized":"2024-04-25T11:05:46.391401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-04-25T11:05:46.391278+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-04-25T11:05:46.391278+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.391278+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:59.413976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1864","reported_seq":1909,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.726790+0000","last_change":"2024-04-25T11:05:38.726820+0000","last_active":"2024-04-25T11:05:38.726790+0000","last_peered":"2024-04-25T11:05:38.726790+0000","last_clean":"2024-04-25T11:05:38.726790+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:38.726790+0000","last_undegraded":"2024-04-25T11:05:38.726790+0000","last_fullsized":"2024-04-25T11:05:38.726790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1864","last_scrub_stamp":"2024-04-25T11:05:38.726698+0000","last_deep_scrub":"28'1864","last_deep_scrub_stamp":"2024-04-25T11:05:38.726698+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.726698+0000","objects_scrubbed":0,"log_size":1864,"log_dups_size":0,"ondisk_log_size":1864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.675410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1879","reported_seq":1924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.129720+0000","last_change":"2024-04-25T11:05:48.129833+0000","last_active":"2024-04-25T11:05:48.129720+0000","last_peered":"2024-04-25T11:05:48.129720+0000","last_clean":"2024-04-25T11:05:48.129720+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:48.129720+0000","last_undegraded":"2024-04-25T11:05:48.129720+0000","last_fullsized":"2024-04-25T11:05:48.129720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1879","last_scrub_stamp":"2024-04-25T11:05:48.129587+0000","last_deep_scrub":"28'1879","last_deep_scrub_stamp":"2024-04-25T11:05:48.129587+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.129587+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:57.661186+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1816","reported_seq":1862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.741409+0000","last_change":"2024-04-25T11:05:41.741476+0000","last_active":"2024-04-25T11:05:41.741409+0000","last_peered":"2024-04-25T11:05:41.741409+0000","last_clean":"2024-04-25T11:05:41.741409+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:41.741409+0000","last_undegraded":"2024-04-25T11:05:41.741409+0000","last_fullsized":"2024-04-25T11:05:41.741409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1816","last_scrub_stamp":"2024-04-25T11:05:41.741218+0000","last_deep_scrub":"28'1816","last_deep_scrub_stamp":"2024-04-25T11:05:41.741218+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.741218+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:21.445623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1835","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.416959+0000","last_change":"2024-04-25T11:05:43.417042+0000","last_active":"2024-04-25T11:05:43.416959+0000","last_peered":"2024-04-25T11:05:43.416959+0000","last_clean":"2024-04-25T11:05:43.416959+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:43.416959+0000","last_undegraded":"2024-04-25T11:05:43.416959+0000","last_fullsized":"2024-04-25T11:05:43.416959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1835","last_scrub_stamp":"2024-04-25T11:05:43.416736+0000","last_deep_scrub":"28'1835","last_deep_scrub_stamp":"2024-04-25T11:05:43.416736+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.416736+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:51.970800+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1953","reported_seq":1998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.344297+0000","last_change":"2024-04-25T11:05:45.344358+0000","last_active":"2024-04-25T11:05:45.344297+0000","last_peered":"2024-04-25T11:05:45.344297+0000","last_clean":"2024-04-25T11:05:45.344297+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:45.344297+0000","last_undegraded":"2024-04-25T11:05:45.344297+0000","last_fullsized":"2024-04-25T11:05:45.344297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1953","last_scrub_stamp":"2024-04-25T11:05:45.344123+0000","last_deep_scrub":"28'1953","last_deep_scrub_stamp":"2024-04-25T11:05:45.344123+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.344123+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.621166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1930","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.329741+0000","last_change":"2024-04-25T11:05:53.329811+0000","last_active":"2024-04-25T11:05:53.329741+0000","last_peered":"2024-04-25T11:05:53.329741+0000","last_clean":"2024-04-25T11:05:53.329741+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:53.329741+0000","last_undegraded":"2024-04-25T11:05:53.329741+0000","last_fullsized":"2024-04-25T11:05:53.329741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1930","last_scrub_stamp":"2024-04-25T11:05:53.329540+0000","last_deep_scrub":"28'1930","last_deep_scrub_stamp":"2024-04-25T11:05:53.329540+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.329540+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:09.164531+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1891","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.112286+0000","last_change":"2024-04-25T11:05:46.112348+0000","last_active":"2024-04-25T11:05:46.112286+0000","last_peered":"2024-04-25T11:05:46.112286+0000","last_clean":"2024-04-25T11:05:46.112286+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:46.112286+0000","last_undegraded":"2024-04-25T11:05:46.112286+0000","last_fullsized":"2024-04-25T11:05:46.112286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1891","last_scrub_stamp":"2024-04-25T11:05:46.112159+0000","last_deep_scrub":"28'1891","last_deep_scrub_stamp":"2024-04-25T11:05:46.112159+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.112159+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.947150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1855","reported_seq":1899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.324909+0000","last_change":"2024-04-25T11:05:47.324953+0000","last_active":"2024-04-25T11:05:47.324909+0000","last_peered":"2024-04-25T11:05:47.324909+0000","last_clean":"2024-04-25T11:05:47.324909+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:47.324909+0000","last_undegraded":"2024-04-25T11:05:47.324909+0000","last_fullsized":"2024-04-25T11:05:47.324909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1855","last_scrub_stamp":"2024-04-25T11:05:47.324802+0000","last_deep_scrub":"28'1855","last_deep_scrub_stamp":"2024-04-25T11:05:47.324802+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.324802+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:19.178889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1824","reported_seq":1869,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.162051+0000","last_change":"2024-04-25T11:05:48.162162+0000","last_active":"2024-04-25T11:05:48.162051+0000","last_peered":"2024-04-25T11:05:48.162051+0000","last_clean":"2024-04-25T11:05:48.162051+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:48.162051+0000","last_undegraded":"2024-04-25T11:05:48.162051+0000","last_fullsized":"2024-04-25T11:05:48.162051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1824","last_scrub_stamp":"2024-04-25T11:05:48.161849+0000","last_deep_scrub":"28'1824","last_deep_scrub_stamp":"2024-04-25T11:05:48.161849+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.161849+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:43.395872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1920","reported_seq":1964,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.383987+0000","last_change":"2024-04-25T11:05:49.384038+0000","last_active":"2024-04-25T11:05:49.383987+0000","last_peered":"2024-04-25T11:05:49.383987+0000","last_clean":"2024-04-25T11:05:49.383987+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:49.383987+0000","last_undegraded":"2024-04-25T11:05:49.383987+0000","last_fullsized":"2024-04-25T11:05:49.383987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1920","last_scrub_stamp":"2024-04-25T11:05:49.383869+0000","last_deep_scrub":"28'1920","last_deep_scrub_stamp":"2024-04-25T11:05:49.383869+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.383869+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:48.857665+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1943","reported_seq":1991,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.152434+0000","last_change":"2024-04-25T11:05:44.152572+0000","last_active":"2024-04-25T11:05:44.152434+0000","last_peered":"2024-04-25T11:05:44.152434+0000","last_clean":"2024-04-25T11:05:44.152434+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:44.152434+0000","last_undegraded":"2024-04-25T11:05:44.152434+0000","last_fullsized":"2024-04-25T11:05:44.152434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:44.152096+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:44.152096+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.152096+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:20.611446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1984","reported_seq":2030,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.743463+0000","last_change":"2024-04-25T11:05:37.743495+0000","last_active":"2024-04-25T11:05:37.743463+0000","last_peered":"2024-04-25T11:05:37.743463+0000","last_clean":"2024-04-25T11:05:37.743463+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:37.743463+0000","last_undegraded":"2024-04-25T11:05:37.743463+0000","last_fullsized":"2024-04-25T11:05:37.743463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1984","last_scrub_stamp":"2024-04-25T11:05:37.743364+0000","last_deep_scrub":"28'1984","last_deep_scrub_stamp":"2024-04-25T11:05:37.743364+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.743364+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:46.297429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1848","reported_seq":1895,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.366588+0000","last_change":"2024-04-25T11:05:45.366625+0000","last_active":"2024-04-25T11:05:45.366588+0000","last_peered":"2024-04-25T11:05:45.366588+0000","last_clean":"2024-04-25T11:05:45.366588+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:45.366588+0000","last_undegraded":"2024-04-25T11:05:45.366588+0000","last_fullsized":"2024-04-25T11:05:45.366588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1848","last_scrub_stamp":"2024-04-25T11:05:45.366399+0000","last_deep_scrub":"28'1848","last_deep_scrub_stamp":"2024-04-25T11:05:45.366399+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.366399+0000","objects_scrubbed":0,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:44.607291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1830","reported_seq":1876,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:54.326535+0000","last_change":"2024-04-25T11:05:54.326583+0000","last_active":"2024-04-25T11:05:54.326535+0000","last_peered":"2024-04-25T11:05:54.326535+0000","last_clean":"2024-04-25T11:05:54.326535+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:54.326535+0000","last_undegraded":"2024-04-25T11:05:54.326535+0000","last_fullsized":"2024-04-25T11:05:54.326535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1830","last_scrub_stamp":"2024-04-25T11:05:54.326397+0000","last_deep_scrub":"28'1830","last_deep_scrub_stamp":"2024-04-25T11:05:54.326397+0000","last_clean_scrub_stamp":"2024-04-25T11:05:54.326397+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:13.541793+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151821,"num_write_kb":4126830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212967,"ondisk_log_size":212967,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121562,"ondisk_log_size":121562,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":242390766,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":2754,"num_read_kb":14599,"num_write":146441,"num_write_kb":1171337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82340,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304652288,"data_stored":484781532,"data_compressed":55811378,"data_compressed_allocated":82255872,"data_compressed_original":262545408,"omap_allocated":0,"internal_metadata":0},"log_size":143259,"ondisk_log_size":143259,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575178,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756724,"kb_used_data":35564,"kb_used_omap":1,"kb_used_meta":721150,"kb_avail":93615116,"statfs":{"total":96636764160,"available":95861878784,"internally_reserved":0,"allocated":36417536,"data_stored":55244212,"data_compressed":6002479,"data_compressed_allocated":9076736,"data_compressed_original":28102656,"omap_allocated":1590,"internal_metadata":738458058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575177,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806104,"kb_used_data":53072,"kb_used_omap":1,"kb_used_meta":753022,"kb_avail":93565736,"statfs":{"total":96636764160,"available":95811313664,"internally_reserved":0,"allocated":54345728,"data_stored":87324364,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":1594,"internal_metadata":771094982},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575177,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757208,"kb_used_data":36240,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93614632,"statfs":{"total":96636764160,"available":95861383168,"internally_reserved":0,"allocated":37109760,"data_stored":58847811,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575176,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":744504,"kb_used_data":41520,"kb_used_omap":1,"kb_used_meta":702974,"kb_avail":93627336,"statfs":{"total":96636764160,"available":95874392064,"internally_reserved":0,"allocated":42516480,"data_stored":67236154,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":1594,"internal_metadata":719845830},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575176,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":856044,"kb_used_data":62884,"kb_used_omap":1,"kb_used_meta":793150,"kb_avail":93515796,"statfs":{"total":96636764160,"available":95760175104,"internally_reserved":0,"allocated":64393216,"data_stored":103540213,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":1593,"internal_metadata":812186055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":467156,"kb_used_data":25100,"kb_used_omap":1,"kb_used_meta":442046,"kb_avail":93904684,"statfs":{"total":96636764160,"available":96158396416,"internally_reserved":0,"allocated":25702400,"data_stored":42070035,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":1595,"internal_metadata":452655557},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575177,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806148,"kb_used_data":21244,"kb_used_omap":1,"kb_used_meta":784894,"kb_avail":93565692,"statfs":{"total":96636764160,"available":95811268608,"internally_reserved":0,"allocated":21753856,"data_stored":34242954,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":1595,"internal_metadata":803731909},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569032,"kb_used_data":24384,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93802808,"statfs":{"total":96636764160,"available":96054075392,"internally_reserved":0,"allocated":24969216,"data_stored":38465941,"data_compressed":4403067,"data_compressed_allocated":6627328,"data_compressed_original":20320256,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21450752,"data_stored":34116777,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64090112,"data_stored":103414036,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109977,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":54042624,"data_stored":87198187,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527667,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:05:58.837 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:58.837 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T10:39:02.351595+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=39, tm_sec=2, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=11, tm_min=5, tm_sec=32, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T11:05:58.838 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T11:06:18.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T11:06:19.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.004+0000 7ff4f3200640 1 Processor -- start 2024-04-25T11:06:19.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.004+0000 7ff4f3200640 1 -- start start 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4f3200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4f3200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 0x7ff4ec159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4f3200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4ec154560 con 0x7ff4ec15a340 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4f3200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ec15dd40 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4f3200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff4ec0b36e0 con 0x7ff4ec0b3220 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48108/0 (socket says 172.21.15.16:48108) 2024-04-25T11:06:19.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 -- 172.21.15.16:0/174980897 learned_addr learned my addr 172.21.15.16:0/174980897 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4e3400640 1 --2- 172.21.15.16:0/174980897 >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 0x7ff4ec159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 -- 172.21.15.16:0/174980897 >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 msgr2=0x7ff4ec159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 --2- 172.21.15.16:0/174980897 >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 0x7ff4ec159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 -- 172.21.15.16:0/174980897 >> v1:172.21.15.16:6789/0 conn(0x7ff4ec15a340 legacy=0x7ff4ec06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4ebe00640 1 -- 172.21.15.16:0/174980897 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec0b39c0 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.008+0000 7ff4e3400640 1 --2- 172.21.15.16:0/174980897 >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 0x7ff4ec159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:19.011 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4ebe00640 1 --2- 172.21.15.16:0/174980897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0744c0 tx=0x7ff4dc01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3034c404f24c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4eb400640 1 -- 172.21.15.16:0/174980897 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0a95f0 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4eb400640 1 -- 172.21.15.16:0/174980897 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0a9790 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4eb400640 1 -- 172.21.15.16:0/174980897 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0a9ba0 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 -- 172.21.15.16:0/174980897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec0b2e10 msgr2=0x7ff4ec0c3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 --2- 172.21.15.16:0/174980897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0744c0 tx=0x7ff4dc01c640 comp rx=0 tx=0).stop 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 -- 172.21.15.16:0/174980897 shutdown_connections 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 --2- 172.21.15.16:0/174980897 >> v2:172.21.15.186:3300/0 conn(0x7ff4ec0b3220 0x7ff4ec159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 --2- 172.21.15.16:0/174980897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec0c3410 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 -- 172.21.15.16:0/174980897 >> 172.21.15.16:0/174980897 conn(0x7ff4ec072a40 msgr2=0x7ff4ec0ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 -- 172.21.15.16:0/174980897 shutdown_connections 2024-04-25T11:06:19.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.012+0000 7ff4f3200640 1 -- 172.21.15.16:0/174980897 wait complete. 2024-04-25T11:06:19.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 Processor -- start 2024-04-25T11:06:19.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- start start 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4ec1fc020 0x7ff4ec0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec0c3950 con 0x7ff4ec15a340 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec15e1d0 con 0x7ff4ec0b2e10 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec06de90 con 0x7ff4ec1fc020 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48120/0 (socket says 172.21.15.16:48120) 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 -- 172.21.15.16:0/62403416 learned_addr learned my addr 172.21.15.16:0/62403416 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:19.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4ebe00640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f1200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4ec1fc020 0x7ff4ec0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 -- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4ec1fc020 msgr2=0x7ff4ec0c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4ec1fc020 0x7ff4ec0c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 -- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4ec0b2e10 msgr2=0x7ff4ec155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 -- 172.21.15.16:0/62403416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec154910 con 0x7ff4ec15a340 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e3400640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400d100 tx=0x7ff4d400d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d401a070 con 0x7ff4ec15a340 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d4015600 con 0x7ff4ec15a340 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec154bf0 con 0x7ff4ec15a340 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40159d0 con 0x7ff4ec15a340 2024-04-25T11:06:19.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.016+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec1fb820 con 0x7ff4ec15a340 2024-04-25T11:06:19.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4ec050750 con 0x7ff4ec15a340 2024-04-25T11:06:19.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff4d401d070 con 0x7ff4ec15a340 2024-04-25T11:06:19.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4e8c00640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 0x7ff4c4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff4d408fa20 con 0x7ff4ec15a340 2024-04-25T11:06:19.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4ebe00640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 0x7ff4c4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.020+0000 7ff4ebe00640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 0x7ff4c4071ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0ae000 tx=0x7ff4dc0b4040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.024+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4d4010070 con 0x7ff4ec15a340 2024-04-25T11:06:19.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.188+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 --> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4ec164170 con 0x7ff4c406f5a0 2024-04-25T11:06:19.212 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.212+0000 7ff4e8c00640 1 -- 172.21.15.16:0/62403416 <== mgr.4100 v2:172.21.15.186:6832/4166069756 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336852 (secure 0 0 0) 0x7ff4ec164170 con 0x7ff4c406f5a0 2024-04-25T11:06:19.216 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:06:19.218 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 msgr2=0x7ff4c4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 0x7ff4c4071ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0ae000 tx=0x7ff4dc0b4040 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 msgr2=0x7ff4ec14c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400d100 tx=0x7ff4d400d5c0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 shutdown_connections 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff4c406f5a0 0x7ff4c4071ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff4ec1fc020 0x7ff4ec0c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4ec15a340 0x7ff4ec14c480 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 --2- 172.21.15.16:0/62403416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4ec0b2e10 0x7ff4ec155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 >> 172.21.15.16:0/62403416 conn(0x7ff4ec072a40 msgr2=0x7ff4ec0cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 shutdown_connections 2024-04-25T11:06:19.219 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.216+0000 7ff4f3200640 1 -- 172.21.15.16:0/62403416 wait complete. 2024-04-25T11:06:19.236 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":848,"stamp":"2024-04-25T11:06:18.380060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":242981134,"num_objects":138,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":138,"num_whiteouts":0,"num_read":7933,"num_read_kb":1313356,"num_write":299483,"num_write_kb":5299795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82340,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":477862,"ondisk_log_size":477862,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5762920,"kb_used_data":300008,"kb_used_omap":12,"kb_used_meta":5462835,"kb_avail":749211800,"statfs":{"total":773094113280,"available":767192883200,"internally_reserved":0,"allocated":307208192,"data_stored":486971684,"data_compressed":55878340,"data_compressed_allocated":82345984,"data_compressed_original":263692288,"omap_allocated":12751,"internal_metadata":5593943601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006438"},"pg_stats":[{"pgid":"2.1f","version":"28'1887","reported_seq":1936,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.708842+0000","last_change":"2024-04-25T11:05:36.708842+0000","last_active":"2024-04-25T11:05:36.708842+0000","last_peered":"2024-04-25T11:05:36.708842+0000","last_clean":"2024-04-25T11:05:36.708842+0000","last_became_active":"2024-04-25T10:38:58.375428+0000","last_became_peered":"2024-04-25T10:38:58.375428+0000","last_unstale":"2024-04-25T11:05:36.708842+0000","last_undegraded":"2024-04-25T11:05:36.708842+0000","last_fullsized":"2024-04-25T11:05:36.708842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1887","last_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_deep_scrub":"28'1887","last_deep_scrub_stamp":"2024-04-25T11:05:36.708689+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.708689+0000","objects_scrubbed":4,"log_size":1887,"log_dups_size":0,"ondisk_log_size":1887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.316407+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1897,"num_write_kb":13180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'1897","reported_seq":1944,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.172603+0000","last_change":"2024-04-25T11:05:40.172634+0000","last_active":"2024-04-25T11:05:40.172603+0000","last_peered":"2024-04-25T11:05:40.172603+0000","last_clean":"2024-04-25T11:05:40.172603+0000","last_became_active":"2024-04-25T10:38:59.342821+0000","last_became_peered":"2024-04-25T10:38:59.342821+0000","last_unstale":"2024-04-25T11:05:40.172603+0000","last_undegraded":"2024-04-25T11:05:40.172603+0000","last_fullsized":"2024-04-25T11:05:40.172603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1897","last_scrub_stamp":"2024-04-25T11:05:40.172519+0000","last_deep_scrub":"28'1897","last_deep_scrub_stamp":"2024-04-25T11:05:40.172519+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.172519+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:12.026607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6392","reported_seq":6475,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:54.256482+0000","last_change":"2024-04-25T11:05:54.256539+0000","last_active":"2024-04-25T11:05:54.256482+0000","last_peered":"2024-04-25T11:05:54.256482+0000","last_clean":"2024-04-25T11:05:54.256482+0000","last_became_active":"2024-04-25T10:39:04.077030+0000","last_became_peered":"2024-04-25T10:39:04.077030+0000","last_unstale":"2024-04-25T11:05:54.256482+0000","last_undegraded":"2024-04-25T11:05:54.256482+0000","last_fullsized":"2024-04-25T11:05:54.256482+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6392","last_scrub_stamp":"2024-04-25T11:05:54.256342+0000","last_deep_scrub":"28'6392","last_deep_scrub_stamp":"2024-04-25T11:05:54.256342+0000","last_clean_scrub_stamp":"2024-04-25T11:05:54.256342+0000","objects_scrubbed":0,"log_size":6292,"log_dups_size":0,"ondisk_log_size":6292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:20.583111+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":10668,"num_write":4427,"num_write_kb":111993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'4892","reported_seq":4941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.235672+0000","last_change":"2024-04-25T11:05:41.235728+0000","last_active":"2024-04-25T11:05:41.235672+0000","last_peered":"2024-04-25T11:05:41.235672+0000","last_clean":"2024-04-25T11:05:41.235672+0000","last_became_active":"2024-04-25T10:38:58.340853+0000","last_became_peered":"2024-04-25T10:38:58.340853+0000","last_unstale":"2024-04-25T11:05:41.235672+0000","last_undegraded":"2024-04-25T11:05:41.235672+0000","last_fullsized":"2024-04-25T11:05:41.235672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4892","last_scrub_stamp":"2024-04-25T11:05:41.235569+0000","last_deep_scrub":"28'4892","last_deep_scrub_stamp":"2024-04-25T11:05:41.235569+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.235569+0000","objects_scrubbed":1,"log_size":4892,"log_dups_size":0,"ondisk_log_size":4892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:40.476460+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4890,"num_write_kb":35125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'1901","reported_seq":1948,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.864511+0000","last_change":"2024-04-25T11:05:42.864511+0000","last_active":"2024-04-25T11:05:42.864511+0000","last_peered":"2024-04-25T11:05:42.864511+0000","last_clean":"2024-04-25T11:05:42.864511+0000","last_became_active":"2024-04-25T10:38:59.354294+0000","last_became_peered":"2024-04-25T10:38:59.354294+0000","last_unstale":"2024-04-25T11:05:42.864511+0000","last_undegraded":"2024-04-25T11:05:42.864511+0000","last_fullsized":"2024-04-25T11:05:42.864511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1901","last_scrub_stamp":"2024-04-25T11:05:42.864388+0000","last_deep_scrub":"28'1901","last_deep_scrub_stamp":"2024-04-25T11:05:42.864388+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.864388+0000","objects_scrubbed":0,"log_size":1901,"log_dups_size":0,"ondisk_log_size":1901,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:13.563246+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6761","reported_seq":6899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.811028+0000","last_change":"2024-04-25T11:05:43.811028+0000","last_active":"2024-04-25T11:05:43.811028+0000","last_peered":"2024-04-25T11:05:43.811028+0000","last_clean":"2024-04-25T11:05:43.811028+0000","last_became_active":"2024-04-25T10:39:03.415488+0000","last_became_peered":"2024-04-25T10:39:03.415488+0000","last_unstale":"2024-04-25T11:05:43.811028+0000","last_undegraded":"2024-04-25T11:05:43.811028+0000","last_fullsized":"2024-04-25T11:05:43.811028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6761","last_scrub_stamp":"2024-04-25T11:05:43.810739+0000","last_deep_scrub":"28'6761","last_deep_scrub_stamp":"2024-04-25T11:05:43.810739+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.810739+0000","objects_scrubbed":0,"log_size":6761,"log_dups_size":0,"ondisk_log_size":6761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:22.675469+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":24638,"num_write":4765,"num_write_kb":131182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'7169","reported_seq":7215,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.523122+0000","last_change":"2024-04-25T11:05:44.523217+0000","last_active":"2024-04-25T11:05:44.523122+0000","last_peered":"2024-04-25T11:05:44.523122+0000","last_clean":"2024-04-25T11:05:44.523122+0000","last_became_active":"2024-04-25T10:38:58.373757+0000","last_became_peered":"2024-04-25T10:38:58.373757+0000","last_unstale":"2024-04-25T11:05:44.523122+0000","last_undegraded":"2024-04-25T11:05:44.523122+0000","last_fullsized":"2024-04-25T11:05:44.523122+0000","mapping_epoch":18,"log_start":"28'100","ondisk_log_start":"28'100","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7169","last_scrub_stamp":"2024-04-25T11:05:44.522947+0000","last_deep_scrub":"28'7169","last_deep_scrub_stamp":"2024-04-25T11:05:44.522947+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.522947+0000","objects_scrubbed":5,"log_size":7069,"log_dups_size":0,"ondisk_log_size":7069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:09.779932+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":7165,"num_write_kb":56595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'1946","reported_seq":1991,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.212928+0000","last_change":"2024-04-25T11:05:50.213007+0000","last_active":"2024-04-25T11:05:50.212928+0000","last_peered":"2024-04-25T11:05:50.212928+0000","last_clean":"2024-04-25T11:05:50.212928+0000","last_became_active":"2024-04-25T10:38:59.360863+0000","last_became_peered":"2024-04-25T10:38:59.360863+0000","last_unstale":"2024-04-25T11:05:50.212928+0000","last_undegraded":"2024-04-25T11:05:50.212928+0000","last_fullsized":"2024-04-25T11:05:50.212928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1946","last_scrub_stamp":"2024-04-25T11:05:50.212611+0000","last_deep_scrub":"28'1946","last_deep_scrub_stamp":"2024-04-25T11:05:50.212611+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.212611+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:02.376742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'6473","reported_seq":6698,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.869802+0000","last_change":"2024-04-25T11:05:50.869951+0000","last_active":"2024-04-25T11:05:50.869802+0000","last_peered":"2024-04-25T11:05:50.869802+0000","last_clean":"2024-04-25T11:05:50.869802+0000","last_became_active":"2024-04-25T10:39:39.056241+0000","last_became_peered":"2024-04-25T10:39:39.056241+0000","last_unstale":"2024-04-25T11:05:50.869802+0000","last_undegraded":"2024-04-25T11:05:50.869802+0000","last_fullsized":"2024-04-25T11:05:50.869802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6473","last_scrub_stamp":"2024-04-25T11:05:50.869452+0000","last_deep_scrub":"28'6473","last_deep_scrub_stamp":"2024-04-25T11:05:50.869452+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.869452+0000","objects_scrubbed":0,"log_size":6473,"log_dups_size":0,"ondisk_log_size":6473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:20.096745+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":45212,"num_write":4436,"num_write_kb":116918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3806","reported_seq":3852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.481919+0000","last_change":"2024-04-25T11:05:45.481981+0000","last_active":"2024-04-25T11:05:45.481919+0000","last_peered":"2024-04-25T11:05:45.481919+0000","last_clean":"2024-04-25T11:05:45.481919+0000","last_became_active":"2024-04-25T10:38:58.381179+0000","last_became_peered":"2024-04-25T10:38:58.381179+0000","last_unstale":"2024-04-25T11:05:45.481919+0000","last_undegraded":"2024-04-25T11:05:45.481919+0000","last_fullsized":"2024-04-25T11:05:45.481919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3806","last_scrub_stamp":"2024-04-25T11:05:45.481780+0000","last_deep_scrub":"28'3806","last_deep_scrub_stamp":"2024-04-25T11:05:45.481780+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.481780+0000","objects_scrubbed":3,"log_size":3806,"log_dups_size":0,"ondisk_log_size":3806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:09.288384+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3806,"num_write_kb":34554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'1896","reported_seq":1925,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.922846+0000","last_change":"2024-04-25T11:05:43.922878+0000","last_active":"2024-04-25T11:05:43.922846+0000","last_peered":"2024-04-25T11:05:43.922846+0000","last_clean":"2024-04-25T11:05:43.922846+0000","last_became_active":"2024-04-25T10:39:38.922577+0000","last_became_peered":"2024-04-25T10:39:38.922577+0000","last_unstale":"2024-04-25T11:05:43.922846+0000","last_undegraded":"2024-04-25T11:05:43.922846+0000","last_fullsized":"2024-04-25T11:05:43.922846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1896","last_scrub_stamp":"2024-04-25T11:05:43.922739+0000","last_deep_scrub":"28'1896","last_deep_scrub_stamp":"2024-04-25T11:05:43.922739+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.922739+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:21.044145+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'6632","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.784467+0000","last_change":"2024-04-25T11:05:42.784626+0000","last_active":"2024-04-25T11:05:42.784467+0000","last_peered":"2024-04-25T11:05:42.784467+0000","last_clean":"2024-04-25T11:05:42.784467+0000","last_became_active":"2024-04-25T10:39:03.410512+0000","last_became_peered":"2024-04-25T10:39:03.410512+0000","last_unstale":"2024-04-25T11:05:42.784467+0000","last_undegraded":"2024-04-25T11:05:42.784467+0000","last_fullsized":"2024-04-25T11:05:42.784467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6632","last_scrub_stamp":"2024-04-25T11:05:42.784084+0000","last_deep_scrub":"28'6632","last_deep_scrub_stamp":"2024-04-25T11:05:42.784084+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.784084+0000","objects_scrubbed":0,"log_size":6632,"log_dups_size":0,"ondisk_log_size":6632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:31.915980+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":22860,"num_write":4668,"num_write_kb":122166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'1916","reported_seq":1962,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.367442+0000","last_change":"2024-04-25T11:05:44.367602+0000","last_active":"2024-04-25T11:05:44.367442+0000","last_peered":"2024-04-25T11:05:44.367442+0000","last_clean":"2024-04-25T11:05:44.367442+0000","last_became_active":"2024-04-25T10:38:59.347870+0000","last_became_peered":"2024-04-25T10:38:59.347870+0000","last_unstale":"2024-04-25T11:05:44.367442+0000","last_undegraded":"2024-04-25T11:05:44.367442+0000","last_fullsized":"2024-04-25T11:05:44.367442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1916","last_scrub_stamp":"2024-04-25T11:05:44.367114+0000","last_deep_scrub":"28'1916","last_deep_scrub_stamp":"2024-04-25T11:05:44.367114+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.367114+0000","objects_scrubbed":0,"log_size":1916,"log_dups_size":0,"ondisk_log_size":1916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:27.315826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'5509","reported_seq":5557,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.407495+0000","last_change":"2024-04-25T11:05:40.407495+0000","last_active":"2024-04-25T11:05:40.407495+0000","last_peered":"2024-04-25T11:05:40.407495+0000","last_clean":"2024-04-25T11:05:40.407495+0000","last_became_active":"2024-04-25T10:38:58.372352+0000","last_became_peered":"2024-04-25T10:38:58.372352+0000","last_unstale":"2024-04-25T11:05:40.407495+0000","last_undegraded":"2024-04-25T11:05:40.407495+0000","last_fullsized":"2024-04-25T11:05:40.407495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5509","last_scrub_stamp":"2024-04-25T11:05:40.407131+0000","last_deep_scrub":"28'5509","last_deep_scrub_stamp":"2024-04-25T11:05:40.407131+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.407131+0000","objects_scrubbed":4,"log_size":5509,"log_dups_size":0,"ondisk_log_size":5509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:27.014849+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":5522,"num_write_kb":39511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3360,"num_omap_keys":7,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6773","reported_seq":6861,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.851162+0000","last_change":"2024-04-25T11:05:45.851162+0000","last_active":"2024-04-25T11:05:45.851162+0000","last_peered":"2024-04-25T11:05:45.851162+0000","last_clean":"2024-04-25T11:05:45.851162+0000","last_became_active":"2024-04-25T10:39:03.416608+0000","last_became_peered":"2024-04-25T10:39:03.416608+0000","last_unstale":"2024-04-25T11:05:45.851162+0000","last_undegraded":"2024-04-25T11:05:45.851162+0000","last_fullsized":"2024-04-25T11:05:45.851162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6773","last_scrub_stamp":"2024-04-25T11:05:45.850866+0000","last_deep_scrub":"28'6773","last_deep_scrub_stamp":"2024-04-25T11:05:45.850866+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.850866+0000","objects_scrubbed":0,"log_size":6773,"log_dups_size":0,"ondisk_log_size":6773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:17.704954+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":11684,"num_write":4716,"num_write_kb":126930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'1925","reported_seq":1971,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.088527+0000","last_change":"2024-04-25T11:05:47.088527+0000","last_active":"2024-04-25T11:05:47.088527+0000","last_peered":"2024-04-25T11:05:47.088527+0000","last_clean":"2024-04-25T11:05:47.088527+0000","last_became_active":"2024-04-25T10:38:59.339149+0000","last_became_peered":"2024-04-25T10:38:59.339149+0000","last_unstale":"2024-04-25T11:05:47.088527+0000","last_undegraded":"2024-04-25T11:05:47.088527+0000","last_fullsized":"2024-04-25T11:05:47.088527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1925","last_scrub_stamp":"2024-04-25T11:05:47.088276+0000","last_deep_scrub":"28'1925","last_deep_scrub_stamp":"2024-04-25T11:05:47.088276+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.088276+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:06.303672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'4965","reported_seq":5014,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.365734+0000","last_change":"2024-04-25T11:05:37.365771+0000","last_active":"2024-04-25T11:05:37.365734+0000","last_peered":"2024-04-25T11:05:37.365734+0000","last_clean":"2024-04-25T11:05:37.365734+0000","last_became_active":"2024-04-25T10:38:58.336418+0000","last_became_peered":"2024-04-25T10:38:58.336418+0000","last_unstale":"2024-04-25T11:05:37.365734+0000","last_undegraded":"2024-04-25T11:05:37.365734+0000","last_fullsized":"2024-04-25T11:05:37.365734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4965","last_scrub_stamp":"2024-04-25T11:05:37.365658+0000","last_deep_scrub":"28'4965","last_deep_scrub_stamp":"2024-04-25T11:05:37.365658+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.365658+0000","objects_scrubbed":3,"log_size":4965,"log_dups_size":0,"ondisk_log_size":4965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:23.973376+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4961,"num_write_kb":39207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'7064","reported_seq":7174,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.896248+0000","last_change":"2024-04-25T11:05:48.896248+0000","last_active":"2024-04-25T11:05:48.896248+0000","last_peered":"2024-04-25T11:05:48.896248+0000","last_clean":"2024-04-25T11:05:48.896248+0000","last_became_active":"2024-04-25T10:39:03.426533+0000","last_became_peered":"2024-04-25T10:39:03.426533+0000","last_unstale":"2024-04-25T11:05:48.896248+0000","last_undegraded":"2024-04-25T11:05:48.896248+0000","last_fullsized":"2024-04-25T11:05:48.896248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7064","last_scrub_stamp":"2024-04-25T11:05:48.896056+0000","last_deep_scrub":"28'7064","last_deep_scrub_stamp":"2024-04-25T11:05:48.896056+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.896056+0000","objects_scrubbed":0,"log_size":7064,"log_dups_size":0,"ondisk_log_size":7064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:29.361736+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":17272,"num_write":5099,"num_write_kb":140880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'1952","reported_seq":1998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.167738+0000","last_change":"2024-04-25T11:05:44.167779+0000","last_active":"2024-04-25T11:05:44.167738+0000","last_peered":"2024-04-25T11:05:44.167738+0000","last_clean":"2024-04-25T11:05:44.167738+0000","last_became_active":"2024-04-25T10:38:59.322273+0000","last_became_peered":"2024-04-25T10:38:59.322273+0000","last_unstale":"2024-04-25T11:05:44.167738+0000","last_undegraded":"2024-04-25T11:05:44.167738+0000","last_fullsized":"2024-04-25T11:05:44.167738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1952","last_scrub_stamp":"2024-04-25T11:05:44.167619+0000","last_deep_scrub":"28'1952","last_deep_scrub_stamp":"2024-04-25T11:05:44.167619+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.167619+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:25.308320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'2280","reported_seq":2329,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.341424+0000","last_change":"2024-04-25T11:05:40.341460+0000","last_active":"2024-04-25T11:05:40.341424+0000","last_peered":"2024-04-25T11:05:40.341424+0000","last_clean":"2024-04-25T11:05:40.341424+0000","last_became_active":"2024-04-25T10:38:58.354172+0000","last_became_peered":"2024-04-25T10:38:58.354172+0000","last_unstale":"2024-04-25T11:05:40.341424+0000","last_undegraded":"2024-04-25T11:05:40.341424+0000","last_fullsized":"2024-04-25T11:05:40.341424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2280","last_scrub_stamp":"2024-04-25T11:05:40.341327+0000","last_deep_scrub":"28'2280","last_deep_scrub_stamp":"2024-04-25T11:05:40.341327+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.341327+0000","objects_scrubbed":2,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:20.045732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2286,"num_write_kb":17435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'6674","reported_seq":6827,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.352950+0000","last_change":"2024-04-25T11:05:51.352950+0000","last_active":"2024-04-25T11:05:51.352950+0000","last_peered":"2024-04-25T11:05:51.352950+0000","last_clean":"2024-04-25T11:05:51.352950+0000","last_became_active":"2024-04-25T10:39:04.079081+0000","last_became_peered":"2024-04-25T10:39:04.079081+0000","last_unstale":"2024-04-25T11:05:51.352950+0000","last_undegraded":"2024-04-25T11:05:51.352950+0000","last_fullsized":"2024-04-25T11:05:51.352950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6674","last_scrub_stamp":"2024-04-25T11:05:51.352812+0000","last_deep_scrub":"28'6674","last_deep_scrub_stamp":"2024-04-25T11:05:51.352812+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.352812+0000","objects_scrubbed":0,"log_size":6674,"log_dups_size":0,"ondisk_log_size":6674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:15.741867+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":28194,"num_write":4766,"num_write_kb":123430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'1932","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.669966+0000","last_change":"2024-04-25T11:05:37.670160+0000","last_active":"2024-04-25T11:05:37.669966+0000","last_peered":"2024-04-25T11:05:37.669966+0000","last_clean":"2024-04-25T11:05:37.669966+0000","last_became_active":"2024-04-25T10:38:59.350871+0000","last_became_peered":"2024-04-25T10:38:59.350871+0000","last_unstale":"2024-04-25T11:05:37.669966+0000","last_undegraded":"2024-04-25T11:05:37.669966+0000","last_fullsized":"2024-04-25T11:05:37.669966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1932","last_scrub_stamp":"2024-04-25T11:05:37.669721+0000","last_deep_scrub":"28'1932","last_deep_scrub_stamp":"2024-04-25T11:05:37.669721+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.669721+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:08.693152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'1621","reported_seq":1669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.402314+0000","last_change":"2024-04-25T11:05:43.402364+0000","last_active":"2024-04-25T11:05:43.402314+0000","last_peered":"2024-04-25T11:05:43.402314+0000","last_clean":"2024-04-25T11:05:43.402314+0000","last_became_active":"2024-04-25T10:38:58.375054+0000","last_became_peered":"2024-04-25T10:38:58.375054+0000","last_unstale":"2024-04-25T11:05:43.402314+0000","last_undegraded":"2024-04-25T11:05:43.402314+0000","last_fullsized":"2024-04-25T11:05:43.402314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1621","last_scrub_stamp":"2024-04-25T11:05:43.402209+0000","last_deep_scrub":"28'1621","last_deep_scrub_stamp":"2024-04-25T11:05:43.402209+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.402209+0000","objects_scrubbed":1,"log_size":1621,"log_dups_size":0,"ondisk_log_size":1621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:40.679251+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1631,"num_write_kb":13086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'7421","reported_seq":7532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.893615+0000","last_change":"2024-04-25T11:05:46.893615+0000","last_active":"2024-04-25T11:05:46.893615+0000","last_peered":"2024-04-25T11:05:46.893615+0000","last_clean":"2024-04-25T11:05:46.893615+0000","last_became_active":"2024-04-25T10:39:03.423830+0000","last_became_peered":"2024-04-25T10:39:03.423830+0000","last_unstale":"2024-04-25T11:05:46.893615+0000","last_undegraded":"2024-04-25T11:05:46.893615+0000","last_fullsized":"2024-04-25T11:05:46.893615+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7421","last_scrub_stamp":"2024-04-25T11:05:46.893135+0000","last_deep_scrub":"28'7421","last_deep_scrub_stamp":"2024-04-25T11:05:46.893135+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.893135+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:46.134027+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5371,"num_write_kb":119270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'1896","reported_seq":1942,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.770328+0000","last_change":"2024-04-25T11:05:39.770356+0000","last_active":"2024-04-25T11:05:39.770328+0000","last_peered":"2024-04-25T11:05:39.770328+0000","last_clean":"2024-04-25T11:05:39.770328+0000","last_became_active":"2024-04-25T10:38:59.345700+0000","last_became_peered":"2024-04-25T10:38:59.345700+0000","last_unstale":"2024-04-25T11:05:39.770328+0000","last_undegraded":"2024-04-25T11:05:39.770328+0000","last_fullsized":"2024-04-25T11:05:39.770328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1896","last_scrub_stamp":"2024-04-25T11:05:39.770241+0000","last_deep_scrub":"28'1896","last_deep_scrub_stamp":"2024-04-25T11:05:39.770241+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.770241+0000","objects_scrubbed":0,"log_size":1896,"log_dups_size":0,"ondisk_log_size":1896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:37.047283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'2482","reported_seq":2530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.481672+0000","last_change":"2024-04-25T11:05:41.481835+0000","last_active":"2024-04-25T11:05:41.481672+0000","last_peered":"2024-04-25T11:05:41.481672+0000","last_clean":"2024-04-25T11:05:41.481672+0000","last_became_active":"2024-04-25T10:38:58.377355+0000","last_became_peered":"2024-04-25T10:38:58.377355+0000","last_unstale":"2024-04-25T11:05:41.481672+0000","last_undegraded":"2024-04-25T11:05:41.481672+0000","last_fullsized":"2024-04-25T11:05:41.481672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2482","last_scrub_stamp":"2024-04-25T11:05:41.481329+0000","last_deep_scrub":"28'2482","last_deep_scrub_stamp":"2024-04-25T11:05:41.481329+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.481329+0000","objects_scrubbed":3,"log_size":2482,"log_dups_size":0,"ondisk_log_size":2482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.345851+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2505,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'6601","reported_seq":6716,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.887613+0000","last_change":"2024-04-25T11:05:49.887613+0000","last_active":"2024-04-25T11:05:49.887613+0000","last_peered":"2024-04-25T11:05:49.887613+0000","last_clean":"2024-04-25T11:05:49.887613+0000","last_became_active":"2024-04-25T10:39:04.080144+0000","last_became_peered":"2024-04-25T10:39:04.080144+0000","last_unstale":"2024-04-25T11:05:49.887613+0000","last_undegraded":"2024-04-25T11:05:49.887613+0000","last_fullsized":"2024-04-25T11:05:49.887613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6601","last_scrub_stamp":"2024-04-25T11:05:49.887312+0000","last_deep_scrub":"28'6601","last_deep_scrub_stamp":"2024-04-25T11:05:49.887312+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.887312+0000","objects_scrubbed":0,"log_size":6601,"log_dups_size":0,"ondisk_log_size":6601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:31.028013+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":18288,"num_write":4630,"num_write_kb":127804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'1852","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.145896+0000","last_change":"2024-04-25T11:05:49.145970+0000","last_active":"2024-04-25T11:05:49.145896+0000","last_peered":"2024-04-25T11:05:49.145896+0000","last_clean":"2024-04-25T11:05:49.145896+0000","last_became_active":"2024-04-25T10:38:59.372307+0000","last_became_peered":"2024-04-25T10:38:59.372307+0000","last_unstale":"2024-04-25T11:05:49.145896+0000","last_undegraded":"2024-04-25T11:05:49.145896+0000","last_fullsized":"2024-04-25T11:05:49.145896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1852","last_scrub_stamp":"2024-04-25T11:05:49.145778+0000","last_deep_scrub":"28'1852","last_deep_scrub_stamp":"2024-04-25T11:05:49.145778+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.145778+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:41.179629+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4071","reported_seq":4193,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.491783+0000","last_change":"2024-04-25T11:05:41.491822+0000","last_active":"2024-04-25T11:05:41.491783+0000","last_peered":"2024-04-25T11:05:41.491783+0000","last_clean":"2024-04-25T11:05:41.491783+0000","last_became_active":"2024-04-25T10:38:58.363185+0000","last_became_peered":"2024-04-25T10:38:58.363185+0000","last_unstale":"2024-04-25T11:05:41.491783+0000","last_undegraded":"2024-04-25T11:05:41.491783+0000","last_fullsized":"2024-04-25T11:05:41.491783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4071","last_scrub_stamp":"2024-04-25T11:05:41.491697+0000","last_deep_scrub":"28'4071","last_deep_scrub_stamp":"2024-04-25T11:05:41.491697+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.491697+0000","objects_scrubbed":3,"log_size":4071,"log_dups_size":0,"ondisk_log_size":4071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:06.748682+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":561401,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":596,"num_write":6804,"num_write_kb":36821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6499","reported_seq":6717,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.255200+0000","last_change":"2024-04-25T11:05:52.255237+0000","last_active":"2024-04-25T11:05:52.255200+0000","last_peered":"2024-04-25T11:05:52.255200+0000","last_clean":"2024-04-25T11:05:52.255200+0000","last_became_active":"2024-04-25T10:39:04.074172+0000","last_became_peered":"2024-04-25T10:39:04.074172+0000","last_unstale":"2024-04-25T11:05:52.255200+0000","last_undegraded":"2024-04-25T11:05:52.255200+0000","last_fullsized":"2024-04-25T11:05:52.255200+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6499","last_scrub_stamp":"2024-04-25T11:05:52.255098+0000","last_deep_scrub":"28'6499","last_deep_scrub_stamp":"2024-04-25T11:05:52.255098+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.255098+0000","objects_scrubbed":0,"log_size":6299,"log_dups_size":0,"ondisk_log_size":6299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:43.207415+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4488,"num_write_kb":132890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'1924","reported_seq":1972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.396326+0000","last_change":"2024-04-25T11:05:43.396326+0000","last_active":"2024-04-25T11:05:43.396326+0000","last_peered":"2024-04-25T11:05:43.396326+0000","last_clean":"2024-04-25T11:05:43.396326+0000","last_became_active":"2024-04-25T10:38:59.319752+0000","last_became_peered":"2024-04-25T10:38:59.319752+0000","last_unstale":"2024-04-25T11:05:43.396326+0000","last_undegraded":"2024-04-25T11:05:43.396326+0000","last_fullsized":"2024-04-25T11:05:43.396326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1924","last_scrub_stamp":"2024-04-25T11:05:43.396213+0000","last_deep_scrub":"28'1924","last_deep_scrub_stamp":"2024-04-25T11:05:43.396213+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.396213+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:14.095071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'4562","reported_seq":4611,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.373788+0000","last_change":"2024-04-25T11:05:42.373788+0000","last_active":"2024-04-25T11:05:42.373788+0000","last_peered":"2024-04-25T11:05:42.373788+0000","last_clean":"2024-04-25T11:05:42.373788+0000","last_became_active":"2024-04-25T10:38:58.373999+0000","last_became_peered":"2024-04-25T10:38:58.373999+0000","last_unstale":"2024-04-25T11:05:42.373788+0000","last_undegraded":"2024-04-25T11:05:42.373788+0000","last_fullsized":"2024-04-25T11:05:42.373788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4562","last_scrub_stamp":"2024-04-25T11:05:42.373509+0000","last_deep_scrub":"28'4562","last_deep_scrub_stamp":"2024-04-25T11:05:42.373509+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.373509+0000","objects_scrubbed":3,"log_size":4562,"log_dups_size":0,"ondisk_log_size":4562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:25.322220+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4570,"num_write_kb":34927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9000,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7286","reported_seq":7546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.816386+0000","last_change":"2024-04-25T11:05:50.816386+0000","last_active":"2024-04-25T11:05:50.816386+0000","last_peered":"2024-04-25T11:05:50.816386+0000","last_clean":"2024-04-25T11:05:50.816386+0000","last_became_active":"2024-04-25T10:39:39.089729+0000","last_became_peered":"2024-04-25T10:39:39.089729+0000","last_unstale":"2024-04-25T11:05:50.816386+0000","last_undegraded":"2024-04-25T11:05:50.816386+0000","last_fullsized":"2024-04-25T11:05:50.816386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7286","last_scrub_stamp":"2024-04-25T11:05:50.816237+0000","last_deep_scrub":"28'7286","last_deep_scrub_stamp":"2024-04-25T11:05:50.816237+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.816237+0000","objects_scrubbed":0,"log_size":7286,"log_dups_size":0,"ondisk_log_size":7286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:10.031633+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":53340,"num_write":5277,"num_write_kb":159191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,2],"acting":[0,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'1892","reported_seq":1940,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.160208+0000","last_change":"2024-04-25T11:05:43.160208+0000","last_active":"2024-04-25T11:05:43.160208+0000","last_peered":"2024-04-25T11:05:43.160208+0000","last_clean":"2024-04-25T11:05:43.160208+0000","last_became_active":"2024-04-25T10:38:59.336838+0000","last_became_peered":"2024-04-25T10:38:59.336838+0000","last_unstale":"2024-04-25T11:05:43.160208+0000","last_undegraded":"2024-04-25T11:05:43.160208+0000","last_fullsized":"2024-04-25T11:05:43.160208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1892","last_scrub_stamp":"2024-04-25T11:05:43.159892+0000","last_deep_scrub":"28'1892","last_deep_scrub_stamp":"2024-04-25T11:05:43.159892+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.159892+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:08.416877+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'4326","reported_seq":4376,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.324384+0000","last_change":"2024-04-25T11:05:38.324384+0000","last_active":"2024-04-25T11:05:38.324384+0000","last_peered":"2024-04-25T11:05:38.324384+0000","last_clean":"2024-04-25T11:05:38.324384+0000","last_became_active":"2024-04-25T10:38:58.342094+0000","last_became_peered":"2024-04-25T10:38:58.342094+0000","last_unstale":"2024-04-25T11:05:38.324384+0000","last_undegraded":"2024-04-25T11:05:38.324384+0000","last_fullsized":"2024-04-25T11:05:38.324384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4326","last_scrub_stamp":"2024-04-25T11:05:38.324263+0000","last_deep_scrub":"28'4326","last_deep_scrub_stamp":"2024-04-25T11:05:38.324263+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.324263+0000","objects_scrubbed":2,"log_size":4326,"log_dups_size":0,"ondisk_log_size":4326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:46.878327+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4330,"num_write_kb":38878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'7463","reported_seq":7766,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.394791+0000","last_change":"2024-04-25T11:05:50.394791+0000","last_active":"2024-04-25T11:05:50.394791+0000","last_peered":"2024-04-25T11:05:50.394791+0000","last_clean":"2024-04-25T11:05:50.394791+0000","last_became_active":"2024-04-25T10:39:03.410240+0000","last_became_peered":"2024-04-25T10:39:03.410240+0000","last_unstale":"2024-04-25T11:05:50.394791+0000","last_undegraded":"2024-04-25T11:05:50.394791+0000","last_fullsized":"2024-04-25T11:05:50.394791+0000","mapping_epoch":23,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7463","last_scrub_stamp":"2024-04-25T11:05:50.394641+0000","last_deep_scrub":"28'7463","last_deep_scrub_stamp":"2024-04-25T11:05:50.394641+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.394641+0000","objects_scrubbed":0,"log_size":7363,"log_dups_size":0,"ondisk_log_size":7363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:06.229632+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":260,"num_read_kb":66040,"num_write":5445,"num_write_kb":157562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'1915","reported_seq":1963,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.726055+0000","last_change":"2024-04-25T11:05:40.726055+0000","last_active":"2024-04-25T11:05:40.726055+0000","last_peered":"2024-04-25T11:05:40.726055+0000","last_clean":"2024-04-25T11:05:40.726055+0000","last_became_active":"2024-04-25T10:38:59.360363+0000","last_became_peered":"2024-04-25T10:38:59.360363+0000","last_unstale":"2024-04-25T11:05:40.726055+0000","last_undegraded":"2024-04-25T11:05:40.726055+0000","last_fullsized":"2024-04-25T11:05:40.726055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1915","last_scrub_stamp":"2024-04-25T11:05:40.725725+0000","last_deep_scrub":"28'1915","last_deep_scrub_stamp":"2024-04-25T11:05:40.725725+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.725725+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:23.674436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'5572","reported_seq":5622,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.092119+0000","last_change":"2024-04-25T11:05:39.092119+0000","last_active":"2024-04-25T11:05:39.092119+0000","last_peered":"2024-04-25T11:05:39.092119+0000","last_clean":"2024-04-25T11:05:39.092119+0000","last_became_active":"2024-04-25T10:38:58.348096+0000","last_became_peered":"2024-04-25T10:38:58.348096+0000","last_unstale":"2024-04-25T11:05:39.092119+0000","last_undegraded":"2024-04-25T11:05:39.092119+0000","last_fullsized":"2024-04-25T11:05:39.092119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5572","last_scrub_stamp":"2024-04-25T11:05:39.091939+0000","last_deep_scrub":"28'5572","last_deep_scrub_stamp":"2024-04-25T11:05:39.091939+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.091939+0000","objects_scrubbed":1,"log_size":5572,"log_dups_size":0,"ondisk_log_size":5572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:40.976082+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5576,"num_write_kb":51781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6966","reported_seq":7049,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.363839+0000","last_change":"2024-04-25T11:05:49.363839+0000","last_active":"2024-04-25T11:05:49.363839+0000","last_peered":"2024-04-25T11:05:49.363839+0000","last_clean":"2024-04-25T11:05:49.363839+0000","last_became_active":"2024-04-25T10:39:03.399392+0000","last_became_peered":"2024-04-25T10:39:03.399392+0000","last_unstale":"2024-04-25T11:05:49.363839+0000","last_undegraded":"2024-04-25T11:05:49.363839+0000","last_fullsized":"2024-04-25T11:05:49.363839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6966","last_scrub_stamp":"2024-04-25T11:05:49.363634+0000","last_deep_scrub":"28'6966","last_deep_scrub_stamp":"2024-04-25T11:05:49.363634+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.363634+0000","objects_scrubbed":0,"log_size":6966,"log_dups_size":0,"ondisk_log_size":6966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:18.590927+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":4982,"num_write_kb":146653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'1914","reported_seq":1962,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.393679+0000","last_change":"2024-04-25T11:05:44.393745+0000","last_active":"2024-04-25T11:05:44.393679+0000","last_peered":"2024-04-25T11:05:44.393679+0000","last_clean":"2024-04-25T11:05:44.393679+0000","last_became_active":"2024-04-25T10:38:59.321213+0000","last_became_peered":"2024-04-25T10:38:59.321213+0000","last_unstale":"2024-04-25T11:05:44.393679+0000","last_undegraded":"2024-04-25T11:05:44.393679+0000","last_fullsized":"2024-04-25T11:05:44.393679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1914","last_scrub_stamp":"2024-04-25T11:05:44.393549+0000","last_deep_scrub":"28'1914","last_deep_scrub_stamp":"2024-04-25T11:05:44.393549+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.393549+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:38.833835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'6031","reported_seq":7477,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.862337+0000","last_change":"2024-04-25T11:05:36.862337+0000","last_active":"2024-04-25T11:05:36.862337+0000","last_peered":"2024-04-25T11:05:36.862337+0000","last_clean":"2024-04-25T11:05:36.862337+0000","last_became_active":"2024-04-25T10:38:58.336791+0000","last_became_peered":"2024-04-25T10:38:58.336791+0000","last_unstale":"2024-04-25T11:05:36.862337+0000","last_undegraded":"2024-04-25T11:05:36.862337+0000","last_fullsized":"2024-04-25T11:05:36.862337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6031","last_scrub_stamp":"2024-04-25T11:05:36.862180+0000","last_deep_scrub":"28'6031","last_deep_scrub_stamp":"2024-04-25T11:05:36.862180+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.862180+0000","objects_scrubbed":5,"log_size":6031,"log_dups_size":0,"ondisk_log_size":6031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:58.349320+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1401,"num_read_kb":5019,"num_write":6041,"num_write_kb":43946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3080,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6549","reported_seq":7099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.399007+0000","last_change":"2024-04-25T11:05:47.399058+0000","last_active":"2024-04-25T11:05:47.399007+0000","last_peered":"2024-04-25T11:05:47.399007+0000","last_clean":"2024-04-25T11:05:47.399007+0000","last_became_active":"2024-04-25T10:39:03.394950+0000","last_became_peered":"2024-04-25T10:39:03.394950+0000","last_unstale":"2024-04-25T11:05:47.399007+0000","last_undegraded":"2024-04-25T11:05:47.399007+0000","last_fullsized":"2024-04-25T11:05:47.399007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6549","last_scrub_stamp":"2024-04-25T11:05:47.398882+0000","last_deep_scrub":"28'6549","last_deep_scrub_stamp":"2024-04-25T11:05:47.398882+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.398882+0000","objects_scrubbed":0,"log_size":6549,"log_dups_size":0,"ondisk_log_size":6549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:27.864562+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":129032,"num_write":4580,"num_write_kb":125268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1830","reported_seq":1877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.812339+0000","last_change":"2024-04-25T11:05:44.812339+0000","last_active":"2024-04-25T11:05:44.812339+0000","last_peered":"2024-04-25T11:05:44.812339+0000","last_clean":"2024-04-25T11:05:44.812339+0000","last_became_active":"2024-04-25T10:38:59.364310+0000","last_became_peered":"2024-04-25T10:38:59.364310+0000","last_unstale":"2024-04-25T11:05:44.812339+0000","last_undegraded":"2024-04-25T11:05:44.812339+0000","last_fullsized":"2024-04-25T11:05:44.812339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1830","last_scrub_stamp":"2024-04-25T11:05:44.812192+0000","last_deep_scrub":"28'1830","last_deep_scrub_stamp":"2024-04-25T11:05:44.812192+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.812192+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:44.053083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'5534","reported_seq":5583,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.418571+0000","last_change":"2024-04-25T11:05:41.418724+0000","last_active":"2024-04-25T11:05:41.418571+0000","last_peered":"2024-04-25T11:05:41.418571+0000","last_clean":"2024-04-25T11:05:41.418571+0000","last_became_active":"2024-04-25T10:38:58.372495+0000","last_became_peered":"2024-04-25T10:38:58.372495+0000","last_unstale":"2024-04-25T11:05:41.418571+0000","last_undegraded":"2024-04-25T11:05:41.418571+0000","last_fullsized":"2024-04-25T11:05:41.418571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5534","last_scrub_stamp":"2024-04-25T11:05:41.418338+0000","last_deep_scrub":"28'5534","last_deep_scrub_stamp":"2024-04-25T11:05:41.418338+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.418338+0000","objects_scrubbed":1,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:49.972402+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5542,"num_write_kb":43623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'6641","reported_seq":6770,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.894978+0000","last_change":"2024-04-25T11:05:47.895015+0000","last_active":"2024-04-25T11:05:47.894978+0000","last_peered":"2024-04-25T11:05:47.894978+0000","last_clean":"2024-04-25T11:05:47.894978+0000","last_became_active":"2024-04-25T10:39:04.076237+0000","last_became_peered":"2024-04-25T10:39:04.076237+0000","last_unstale":"2024-04-25T11:05:47.894978+0000","last_undegraded":"2024-04-25T11:05:47.894978+0000","last_fullsized":"2024-04-25T11:05:47.894978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6641","last_scrub_stamp":"2024-04-25T11:05:47.894854+0000","last_deep_scrub":"28'6641","last_deep_scrub_stamp":"2024-04-25T11:05:47.894854+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.894854+0000","objects_scrubbed":0,"log_size":6641,"log_dups_size":0,"ondisk_log_size":6641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:29.035555+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":22098,"num_write":4590,"num_write_kb":120036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'1945","reported_seq":1992,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.175969+0000","last_change":"2024-04-25T11:05:38.175969+0000","last_active":"2024-04-25T11:05:38.175969+0000","last_peered":"2024-04-25T11:05:38.175969+0000","last_clean":"2024-04-25T11:05:38.175969+0000","last_became_active":"2024-04-25T10:38:59.350357+0000","last_became_peered":"2024-04-25T10:38:59.350357+0000","last_unstale":"2024-04-25T11:05:38.175969+0000","last_undegraded":"2024-04-25T11:05:38.175969+0000","last_fullsized":"2024-04-25T11:05:38.175969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1945","last_scrub_stamp":"2024-04-25T11:05:38.175727+0000","last_deep_scrub":"28'1945","last_deep_scrub_stamp":"2024-04-25T11:05:38.175727+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.175727+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:01.982331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3775","reported_seq":3825,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.070500+0000","last_change":"2024-04-25T11:05:38.070500+0000","last_active":"2024-04-25T11:05:38.070500+0000","last_peered":"2024-04-25T11:05:38.070500+0000","last_clean":"2024-04-25T11:05:38.070500+0000","last_became_active":"2024-04-25T10:38:58.353368+0000","last_became_peered":"2024-04-25T10:38:58.353368+0000","last_unstale":"2024-04-25T11:05:38.070500+0000","last_undegraded":"2024-04-25T11:05:38.070500+0000","last_fullsized":"2024-04-25T11:05:38.070500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3775","last_scrub_stamp":"2024-04-25T11:05:38.070107+0000","last_deep_scrub":"28'3775","last_deep_scrub_stamp":"2024-04-25T11:05:38.070107+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.070107+0000","objects_scrubbed":4,"log_size":3775,"log_dups_size":0,"ondisk_log_size":3775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:39.934629+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194338,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3784,"num_write_kb":34571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'74","reported_seq":147,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.366922+0000","last_change":"2024-04-25T11:05:39.367005+0000","last_active":"2024-04-25T11:05:39.366922+0000","last_peered":"2024-04-25T11:05:39.366922+0000","last_clean":"2024-04-25T11:05:39.366922+0000","last_became_active":"2024-04-25T10:38:47.756170+0000","last_became_peered":"2024-04-25T10:38:47.756170+0000","last_unstale":"2024-04-25T11:05:39.366922+0000","last_undegraded":"2024-04-25T11:05:39.366922+0000","last_fullsized":"2024-04-25T11:05:39.366922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'74","last_scrub_stamp":"2024-04-25T11:05:39.366733+0000","last_deep_scrub":"28'74","last_deep_scrub_stamp":"2024-04-25T11:05:39.366733+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.366733+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:10.390163+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'6746","reported_seq":6891,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.339497+0000","last_change":"2024-04-25T11:05:51.339497+0000","last_active":"2024-04-25T11:05:51.339497+0000","last_peered":"2024-04-25T11:05:51.339497+0000","last_clean":"2024-04-25T11:05:51.339497+0000","last_became_active":"2024-04-25T10:39:04.078734+0000","last_became_peered":"2024-04-25T10:39:04.078734+0000","last_unstale":"2024-04-25T11:05:51.339497+0000","last_undegraded":"2024-04-25T11:05:51.339497+0000","last_fullsized":"2024-04-25T11:05:51.339497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6746","last_scrub_stamp":"2024-04-25T11:05:51.339006+0000","last_deep_scrub":"28'6746","last_deep_scrub_stamp":"2024-04-25T11:05:51.339006+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.339006+0000","objects_scrubbed":0,"log_size":6746,"log_dups_size":0,"ondisk_log_size":6746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:50.812802+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4798,"num_write_kb":130135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'1910","reported_seq":1956,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.356925+0000","last_change":"2024-04-25T11:05:46.356925+0000","last_active":"2024-04-25T11:05:46.356925+0000","last_peered":"2024-04-25T11:05:46.356925+0000","last_clean":"2024-04-25T11:05:46.356925+0000","last_became_active":"2024-04-25T10:38:59.353590+0000","last_became_peered":"2024-04-25T10:38:59.353590+0000","last_unstale":"2024-04-25T11:05:46.356925+0000","last_undegraded":"2024-04-25T11:05:46.356925+0000","last_fullsized":"2024-04-25T11:05:46.356925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1910","last_scrub_stamp":"2024-04-25T11:05:46.356614+0000","last_deep_scrub":"28'1910","last_deep_scrub_stamp":"2024-04-25T11:05:46.356614+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.356614+0000","objects_scrubbed":0,"log_size":1910,"log_dups_size":0,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:17.055472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'4308","reported_seq":4357,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.831197+0000","last_change":"2024-04-25T11:05:38.831197+0000","last_active":"2024-04-25T11:05:38.831197+0000","last_peered":"2024-04-25T11:05:38.831197+0000","last_clean":"2024-04-25T11:05:38.831197+0000","last_became_active":"2024-04-25T10:38:58.379429+0000","last_became_peered":"2024-04-25T10:38:58.379429+0000","last_unstale":"2024-04-25T11:05:38.831197+0000","last_undegraded":"2024-04-25T11:05:38.831197+0000","last_fullsized":"2024-04-25T11:05:38.831197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4308","last_scrub_stamp":"2024-04-25T11:05:38.831084+0000","last_deep_scrub":"28'4308","last_deep_scrub_stamp":"2024-04-25T11:05:38.831084+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.831084+0000","objects_scrubbed":4,"log_size":4308,"log_dups_size":0,"ondisk_log_size":4308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:30.665233+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4304,"num_write_kb":38883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'6656","reported_seq":6889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.290774+0000","last_change":"2024-04-25T11:05:50.290855+0000","last_active":"2024-04-25T11:05:50.290774+0000","last_peered":"2024-04-25T11:05:50.290774+0000","last_clean":"2024-04-25T11:05:50.290774+0000","last_became_active":"2024-04-25T10:39:04.075219+0000","last_became_peered":"2024-04-25T10:39:04.075219+0000","last_unstale":"2024-04-25T11:05:50.290774+0000","last_undegraded":"2024-04-25T11:05:50.290774+0000","last_fullsized":"2024-04-25T11:05:50.290774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6656","last_scrub_stamp":"2024-04-25T11:05:50.290555+0000","last_deep_scrub":"28'6656","last_deep_scrub_stamp":"2024-04-25T11:05:50.290555+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.290555+0000","objects_scrubbed":0,"log_size":6656,"log_dups_size":0,"ondisk_log_size":6656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:49.531446+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":48514,"num_write":4615,"num_write_kb":121061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'1900","reported_seq":1947,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.971342+0000","last_change":"2024-04-25T11:05:36.971342+0000","last_active":"2024-04-25T11:05:36.971342+0000","last_peered":"2024-04-25T11:05:36.971342+0000","last_clean":"2024-04-25T11:05:36.971342+0000","last_became_active":"2024-04-25T10:38:59.337946+0000","last_became_peered":"2024-04-25T10:38:59.337946+0000","last_unstale":"2024-04-25T11:05:36.971342+0000","last_undegraded":"2024-04-25T11:05:36.971342+0000","last_fullsized":"2024-04-25T11:05:36.971342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1900","last_scrub_stamp":"2024-04-25T11:05:36.971020+0000","last_deep_scrub":"28'1900","last_deep_scrub_stamp":"2024-04-25T11:05:36.971020+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.971020+0000","objects_scrubbed":0,"log_size":1900,"log_dups_size":0,"ondisk_log_size":1900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:14.092426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'5445","reported_seq":5494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.340195+0000","last_change":"2024-04-25T11:05:39.340195+0000","last_active":"2024-04-25T11:05:39.340195+0000","last_peered":"2024-04-25T11:05:39.340195+0000","last_clean":"2024-04-25T11:05:39.340195+0000","last_became_active":"2024-04-25T10:38:58.350281+0000","last_became_peered":"2024-04-25T10:38:58.350281+0000","last_unstale":"2024-04-25T11:05:39.340195+0000","last_undegraded":"2024-04-25T11:05:39.340195+0000","last_fullsized":"2024-04-25T11:05:39.340195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5445","last_scrub_stamp":"2024-04-25T11:05:39.340069+0000","last_deep_scrub":"28'5445","last_deep_scrub_stamp":"2024-04-25T11:05:39.340069+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.340069+0000","objects_scrubbed":5,"log_size":5445,"log_dups_size":0,"ondisk_log_size":5445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:22.288780+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5441,"num_write_kb":43526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'6687","reported_seq":7013,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.828456+0000","last_change":"2024-04-25T11:05:45.828456+0000","last_active":"2024-04-25T11:05:45.828456+0000","last_peered":"2024-04-25T11:05:45.828456+0000","last_clean":"2024-04-25T11:05:45.828456+0000","last_became_active":"2024-04-25T10:39:03.410330+0000","last_became_peered":"2024-04-25T10:39:03.410330+0000","last_unstale":"2024-04-25T11:05:45.828456+0000","last_undegraded":"2024-04-25T11:05:45.828456+0000","last_fullsized":"2024-04-25T11:05:45.828456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6687","last_scrub_stamp":"2024-04-25T11:05:45.828228+0000","last_deep_scrub":"28'6687","last_deep_scrub_stamp":"2024-04-25T11:05:45.828228+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.828228+0000","objects_scrubbed":0,"log_size":6687,"log_dups_size":0,"ondisk_log_size":6687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:45.302024+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":72136,"num_write":4636,"num_write_kb":135921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'1836","reported_seq":1866,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.386553+0000","last_change":"2024-04-25T11:05:52.386638+0000","last_active":"2024-04-25T11:05:52.386553+0000","last_peered":"2024-04-25T11:05:52.386553+0000","last_clean":"2024-04-25T11:05:52.386553+0000","last_became_active":"2024-04-25T10:39:38.923388+0000","last_became_peered":"2024-04-25T10:39:38.923388+0000","last_unstale":"2024-04-25T11:05:52.386553+0000","last_undegraded":"2024-04-25T11:05:52.386553+0000","last_fullsized":"2024-04-25T11:05:52.386553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1836","last_scrub_stamp":"2024-04-25T11:05:52.386445+0000","last_deep_scrub":"28'1836","last_deep_scrub_stamp":"2024-04-25T11:05:52.386445+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.386445+0000","objects_scrubbed":0,"log_size":1836,"log_dups_size":0,"ondisk_log_size":1836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:54.550532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"28'4839","reported_seq":4888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.889205+0000","last_change":"2024-04-25T11:05:37.889205+0000","last_active":"2024-04-25T11:05:37.889205+0000","last_peered":"2024-04-25T11:05:37.889205+0000","last_clean":"2024-04-25T11:05:37.889205+0000","last_became_active":"2024-04-25T10:38:58.339456+0000","last_became_peered":"2024-04-25T10:38:58.339456+0000","last_unstale":"2024-04-25T11:05:37.889205+0000","last_undegraded":"2024-04-25T11:05:37.889205+0000","last_fullsized":"2024-04-25T11:05:37.889205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4839","last_scrub_stamp":"2024-04-25T11:05:37.889073+0000","last_deep_scrub":"28'4839","last_deep_scrub_stamp":"2024-04-25T11:05:37.889073+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.889073+0000","objects_scrubbed":6,"log_size":4839,"log_dups_size":0,"ondisk_log_size":4839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:19.476740+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4839,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'7079","reported_seq":7155,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.261851+0000","last_change":"2024-04-25T11:05:53.261901+0000","last_active":"2024-04-25T11:05:53.261851+0000","last_peered":"2024-04-25T11:05:53.261851+0000","last_clean":"2024-04-25T11:05:53.261851+0000","last_became_active":"2024-04-25T10:39:04.082989+0000","last_became_peered":"2024-04-25T10:39:04.082989+0000","last_unstale":"2024-04-25T11:05:53.261851+0000","last_undegraded":"2024-04-25T11:05:53.261851+0000","last_fullsized":"2024-04-25T11:05:53.261851+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7079","last_scrub_stamp":"2024-04-25T11:05:53.261709+0000","last_deep_scrub":"28'7079","last_deep_scrub_stamp":"2024-04-25T11:05:53.261709+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.261709+0000","objects_scrubbed":0,"log_size":7079,"log_dups_size":0,"ondisk_log_size":7079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:50:02.793308+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":8636,"num_write":5048,"num_write_kb":119873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'1923","reported_seq":1969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.319417+0000","last_change":"2024-04-25T11:05:50.319417+0000","last_active":"2024-04-25T11:05:50.319417+0000","last_peered":"2024-04-25T11:05:50.319417+0000","last_clean":"2024-04-25T11:05:50.319417+0000","last_became_active":"2024-04-25T10:38:59.367353+0000","last_became_peered":"2024-04-25T10:38:59.367353+0000","last_unstale":"2024-04-25T11:05:50.319417+0000","last_undegraded":"2024-04-25T11:05:50.319417+0000","last_fullsized":"2024-04-25T11:05:50.319417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1923","last_scrub_stamp":"2024-04-25T11:05:50.318969+0000","last_deep_scrub":"28'1923","last_deep_scrub_stamp":"2024-04-25T11:05:50.318969+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.318969+0000","objects_scrubbed":0,"log_size":1923,"log_dups_size":0,"ondisk_log_size":1923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:45.552992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'3726","reported_seq":3775,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.815859+0000","last_change":"2024-04-25T11:05:36.815859+0000","last_active":"2024-04-25T11:05:36.815859+0000","last_peered":"2024-04-25T11:05:36.815859+0000","last_clean":"2024-04-25T11:05:36.815859+0000","last_became_active":"2024-04-25T10:38:58.351791+0000","last_became_peered":"2024-04-25T10:38:58.351791+0000","last_unstale":"2024-04-25T11:05:36.815859+0000","last_undegraded":"2024-04-25T11:05:36.815859+0000","last_fullsized":"2024-04-25T11:05:36.815859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3726","last_scrub_stamp":"2024-04-25T11:05:36.815341+0000","last_deep_scrub":"28'3726","last_deep_scrub_stamp":"2024-04-25T11:05:36.815341+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.815341+0000","objects_scrubbed":6,"log_size":3726,"log_dups_size":0,"ondisk_log_size":3726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:13.936747+0000","scrub_duration":131,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3720,"num_write_kb":30429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'6596","reported_seq":6729,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.842128+0000","last_change":"2024-04-25T11:05:44.842239+0000","last_active":"2024-04-25T11:05:44.842128+0000","last_peered":"2024-04-25T11:05:44.842128+0000","last_clean":"2024-04-25T11:05:44.842128+0000","last_became_active":"2024-04-25T10:39:03.417081+0000","last_became_peered":"2024-04-25T10:39:03.417081+0000","last_unstale":"2024-04-25T11:05:44.842128+0000","last_undegraded":"2024-04-25T11:05:44.842128+0000","last_fullsized":"2024-04-25T11:05:44.842128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6596","last_scrub_stamp":"2024-04-25T11:05:44.841905+0000","last_deep_scrub":"28'6596","last_deep_scrub_stamp":"2024-04-25T11:05:44.841905+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.841905+0000","objects_scrubbed":0,"log_size":6596,"log_dups_size":0,"ondisk_log_size":6596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:15.540763+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":23114,"num_write":4504,"num_write_kb":119124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'1943","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.341465+0000","last_change":"2024-04-25T11:05:51.341537+0000","last_active":"2024-04-25T11:05:51.341465+0000","last_peered":"2024-04-25T11:05:51.341465+0000","last_clean":"2024-04-25T11:05:51.341465+0000","last_became_active":"2024-04-25T10:38:59.362223+0000","last_became_peered":"2024-04-25T10:38:59.362223+0000","last_unstale":"2024-04-25T11:05:51.341465+0000","last_undegraded":"2024-04-25T11:05:51.341465+0000","last_fullsized":"2024-04-25T11:05:51.341465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:51.341275+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:51.341275+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.341275+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:32.481976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'2230","reported_seq":2278,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.867322+0000","last_change":"2024-04-25T11:05:35.867375+0000","last_active":"2024-04-25T11:05:35.867322+0000","last_peered":"2024-04-25T11:05:35.867322+0000","last_clean":"2024-04-25T11:05:35.867322+0000","last_became_active":"2024-04-25T10:38:58.329896+0000","last_became_peered":"2024-04-25T10:38:58.329896+0000","last_unstale":"2024-04-25T11:05:35.867322+0000","last_undegraded":"2024-04-25T11:05:35.867322+0000","last_fullsized":"2024-04-25T11:05:35.867322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2230","last_scrub_stamp":"2024-04-25T11:05:35.867248+0000","last_deep_scrub":"28'2230","last_deep_scrub_stamp":"2024-04-25T11:05:35.867248+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.867248+0000","objects_scrubbed":9,"log_size":2230,"log_dups_size":0,"ondisk_log_size":2230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:20.088328+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2236,"num_write_kb":17426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6569","reported_seq":6829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.866569+0000","last_change":"2024-04-25T11:05:46.866604+0000","last_active":"2024-04-25T11:05:46.866569+0000","last_peered":"2024-04-25T11:05:46.866569+0000","last_clean":"2024-04-25T11:05:46.866569+0000","last_became_active":"2024-04-25T10:39:03.414883+0000","last_became_peered":"2024-04-25T10:39:03.414883+0000","last_unstale":"2024-04-25T11:05:46.866569+0000","last_undegraded":"2024-04-25T11:05:46.866569+0000","last_fullsized":"2024-04-25T11:05:46.866569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6569","last_scrub_stamp":"2024-04-25T11:05:46.866448+0000","last_deep_scrub":"28'6569","last_deep_scrub_stamp":"2024-04-25T11:05:46.866448+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.866448+0000","objects_scrubbed":0,"log_size":6569,"log_dups_size":0,"ondisk_log_size":6569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:42.100471+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":55626,"num_write":4527,"num_write_kb":127214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'1852","reported_seq":1897,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.422870+0000","last_change":"2024-04-25T11:05:42.422918+0000","last_active":"2024-04-25T11:05:42.422870+0000","last_peered":"2024-04-25T11:05:42.422870+0000","last_clean":"2024-04-25T11:05:42.422870+0000","last_became_active":"2024-04-25T10:38:59.341935+0000","last_became_peered":"2024-04-25T10:38:59.341935+0000","last_unstale":"2024-04-25T11:05:42.422870+0000","last_undegraded":"2024-04-25T11:05:42.422870+0000","last_fullsized":"2024-04-25T11:05:42.422870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1852","last_scrub_stamp":"2024-04-25T11:05:42.422756+0000","last_deep_scrub":"28'1852","last_deep_scrub_stamp":"2024-04-25T11:05:42.422756+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.422756+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:44.306900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'1714","reported_seq":1761,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.545836+0000","last_change":"2024-04-25T11:05:37.545918+0000","last_active":"2024-04-25T11:05:37.545836+0000","last_peered":"2024-04-25T11:05:37.545836+0000","last_clean":"2024-04-25T11:05:37.545836+0000","last_became_active":"2024-04-25T10:38:58.353597+0000","last_became_peered":"2024-04-25T10:38:58.353597+0000","last_unstale":"2024-04-25T11:05:37.545836+0000","last_undegraded":"2024-04-25T11:05:37.545836+0000","last_fullsized":"2024-04-25T11:05:37.545836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1714","last_scrub_stamp":"2024-04-25T11:05:37.545588+0000","last_deep_scrub":"28'1714","last_deep_scrub_stamp":"2024-04-25T11:05:37.545588+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.545588+0000","objects_scrubbed":3,"log_size":1714,"log_dups_size":0,"ondisk_log_size":1714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:37.422156+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195291,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1716,"num_write_kb":21294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6817","reported_seq":6918,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:55.206123+0000","last_change":"2024-04-25T11:05:55.206161+0000","last_active":"2024-04-25T11:05:55.206123+0000","last_peered":"2024-04-25T11:05:55.206123+0000","last_clean":"2024-04-25T11:05:55.206123+0000","last_became_active":"2024-04-25T10:39:04.085011+0000","last_became_peered":"2024-04-25T10:39:04.085011+0000","last_unstale":"2024-04-25T11:05:55.206123+0000","last_undegraded":"2024-04-25T11:05:55.206123+0000","last_fullsized":"2024-04-25T11:05:55.206123+0000","mapping_epoch":23,"log_start":"28'504","ondisk_log_start":"28'504","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6817","last_scrub_stamp":"2024-04-25T11:05:55.205998+0000","last_deep_scrub":"28'6817","last_deep_scrub_stamp":"2024-04-25T11:05:55.205998+0000","last_clean_scrub_stamp":"2024-04-25T11:05:55.205998+0000","objects_scrubbed":0,"log_size":6313,"log_dups_size":0,"ondisk_log_size":6313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:30.616131+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":15240,"num_write":4812,"num_write_kb":140469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'1911","reported_seq":1956,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.357055+0000","last_change":"2024-04-25T11:05:52.357101+0000","last_active":"2024-04-25T11:05:52.357055+0000","last_peered":"2024-04-25T11:05:52.357055+0000","last_clean":"2024-04-25T11:05:52.357055+0000","last_became_active":"2024-04-25T10:38:59.368341+0000","last_became_peered":"2024-04-25T10:38:59.368341+0000","last_unstale":"2024-04-25T11:05:52.357055+0000","last_undegraded":"2024-04-25T11:05:52.357055+0000","last_fullsized":"2024-04-25T11:05:52.357055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1911","last_scrub_stamp":"2024-04-25T11:05:52.356951+0000","last_deep_scrub":"28'1911","last_deep_scrub_stamp":"2024-04-25T11:05:52.356951+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.356951+0000","objects_scrubbed":0,"log_size":1911,"log_dups_size":0,"ondisk_log_size":1911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:04.521082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1359","reported_seq":1407,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.120216+0000","last_change":"2024-04-25T11:05:40.120271+0000","last_active":"2024-04-25T11:05:40.120216+0000","last_peered":"2024-04-25T11:05:40.120216+0000","last_clean":"2024-04-25T11:05:40.120216+0000","last_became_active":"2024-04-25T10:38:58.367666+0000","last_became_peered":"2024-04-25T10:38:58.367666+0000","last_unstale":"2024-04-25T11:05:40.120216+0000","last_undegraded":"2024-04-25T11:05:40.120216+0000","last_fullsized":"2024-04-25T11:05:40.120216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1359","last_scrub_stamp":"2024-04-25T11:05:40.120108+0000","last_deep_scrub":"28'1359","last_deep_scrub_stamp":"2024-04-25T11:05:40.120108+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.120108+0000","objects_scrubbed":3,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:48.674172+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1362,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6439","reported_seq":6662,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:56.162418+0000","last_change":"2024-04-25T11:05:56.162475+0000","last_active":"2024-04-25T11:05:56.162418+0000","last_peered":"2024-04-25T11:05:56.162418+0000","last_clean":"2024-04-25T11:05:56.162418+0000","last_became_active":"2024-04-25T10:39:39.093126+0000","last_became_peered":"2024-04-25T10:39:39.093126+0000","last_unstale":"2024-04-25T11:05:56.162418+0000","last_undegraded":"2024-04-25T11:05:56.162418+0000","last_fullsized":"2024-04-25T11:05:56.162418+0000","mapping_epoch":27,"log_start":"28'100","ondisk_log_start":"28'100","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6439","last_scrub_stamp":"2024-04-25T11:05:56.162266+0000","last_deep_scrub":"28'6439","last_deep_scrub_stamp":"2024-04-25T11:05:56.162266+0000","last_clean_scrub_stamp":"2024-04-25T11:05:56.162266+0000","objects_scrubbed":0,"log_size":6339,"log_dups_size":0,"ondisk_log_size":6339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:21:53.818460+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":44450,"num_write":4468,"num_write_kb":130436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'1931","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.847931+0000","last_change":"2024-04-25T11:05:41.847962+0000","last_active":"2024-04-25T11:05:41.847931+0000","last_peered":"2024-04-25T11:05:41.847931+0000","last_clean":"2024-04-25T11:05:41.847931+0000","last_became_active":"2024-04-25T10:38:59.353710+0000","last_became_peered":"2024-04-25T10:38:59.353710+0000","last_unstale":"2024-04-25T11:05:41.847931+0000","last_undegraded":"2024-04-25T11:05:41.847931+0000","last_fullsized":"2024-04-25T11:05:41.847931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1931","last_scrub_stamp":"2024-04-25T11:05:41.847820+0000","last_deep_scrub":"28'1931","last_deep_scrub_stamp":"2024-04-25T11:05:41.847820+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.847820+0000","objects_scrubbed":0,"log_size":1931,"log_dups_size":0,"ondisk_log_size":1931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:05.654424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'3878","reported_seq":3925,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.785709+0000","last_change":"2024-04-25T11:05:35.785763+0000","last_active":"2024-04-25T11:05:35.785709+0000","last_peered":"2024-04-25T11:05:35.785709+0000","last_clean":"2024-04-25T11:05:35.785709+0000","last_became_active":"2024-04-25T10:38:58.350655+0000","last_became_peered":"2024-04-25T10:38:58.350655+0000","last_unstale":"2024-04-25T11:05:35.785709+0000","last_undegraded":"2024-04-25T11:05:35.785709+0000","last_fullsized":"2024-04-25T11:05:35.785709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3878","last_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_deep_scrub":"28'3878","last_deep_scrub_stamp":"2024-04-25T11:05:35.785612+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.785612+0000","objects_scrubbed":7,"log_size":3878,"log_dups_size":0,"ondisk_log_size":3878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:06.809043+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3882,"num_write_kb":30493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8080,"num_omap_keys":16,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'6424","reported_seq":6629,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:52.239782+0000","last_change":"2024-04-25T11:05:52.239915+0000","last_active":"2024-04-25T11:05:52.239782+0000","last_peered":"2024-04-25T11:05:52.239782+0000","last_clean":"2024-04-25T11:05:52.239782+0000","last_became_active":"2024-04-25T10:39:04.077580+0000","last_became_peered":"2024-04-25T10:39:04.077580+0000","last_unstale":"2024-04-25T11:05:52.239782+0000","last_undegraded":"2024-04-25T11:05:52.239782+0000","last_fullsized":"2024-04-25T11:05:52.239782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6424","last_scrub_stamp":"2024-04-25T11:05:52.239567+0000","last_deep_scrub":"28'6424","last_deep_scrub_stamp":"2024-04-25T11:05:52.239567+0000","last_clean_scrub_stamp":"2024-04-25T11:05:52.239567+0000","objects_scrubbed":0,"log_size":6424,"log_dups_size":0,"ondisk_log_size":6424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:11.454963+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":41656,"num_write":4474,"num_write_kb":118590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'1853","reported_seq":1898,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.369411+0000","last_change":"2024-04-25T11:05:38.369496+0000","last_active":"2024-04-25T11:05:38.369411+0000","last_peered":"2024-04-25T11:05:38.369411+0000","last_clean":"2024-04-25T11:05:38.369411+0000","last_became_active":"2024-04-25T10:38:59.354023+0000","last_became_peered":"2024-04-25T10:38:59.354023+0000","last_unstale":"2024-04-25T11:05:38.369411+0000","last_undegraded":"2024-04-25T11:05:38.369411+0000","last_fullsized":"2024-04-25T11:05:38.369411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1853","last_scrub_stamp":"2024-04-25T11:05:38.369177+0000","last_deep_scrub":"28'1853","last_deep_scrub_stamp":"2024-04-25T11:05:38.369177+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.369177+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:24.275875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'7375","reported_seq":8047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.226689+0000","last_change":"2024-04-25T11:05:39.614502+0000","last_active":"2024-04-25T11:05:42.226689+0000","last_peered":"2024-04-25T11:05:42.226689+0000","last_clean":"2024-04-25T11:05:42.226689+0000","last_became_active":"2024-04-25T10:38:58.361457+0000","last_became_peered":"2024-04-25T10:38:58.361457+0000","last_unstale":"2024-04-25T11:05:42.226689+0000","last_undegraded":"2024-04-25T11:05:42.226689+0000","last_fullsized":"2024-04-25T11:05:42.226689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7373","last_scrub_stamp":"2024-04-25T11:05:39.614026+0000","last_deep_scrub":"28'7373","last_deep_scrub_stamp":"2024-04-25T11:05:39.614026+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.614026+0000","objects_scrubbed":11,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:25.520724+0000","scrub_duration":163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19526845,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":627,"num_read_kb":4504,"num_write":7375,"num_write_kb":55482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'6574","reported_seq":6647,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.387896+0000","last_change":"2024-04-25T11:05:48.387935+0000","last_active":"2024-04-25T11:05:48.387896+0000","last_peered":"2024-04-25T11:05:48.387896+0000","last_clean":"2024-04-25T11:05:48.387896+0000","last_became_active":"2024-04-25T10:39:03.399005+0000","last_became_peered":"2024-04-25T10:39:03.399005+0000","last_unstale":"2024-04-25T11:05:48.387896+0000","last_undegraded":"2024-04-25T11:05:48.387896+0000","last_fullsized":"2024-04-25T11:05:48.387896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6574","last_scrub_stamp":"2024-04-25T11:05:48.387747+0000","last_deep_scrub":"28'6574","last_deep_scrub_stamp":"2024-04-25T11:05:48.387747+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.387747+0000","objects_scrubbed":0,"log_size":6574,"log_dups_size":0,"ondisk_log_size":6574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:29.528448+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":8128,"num_write":4583,"num_write_kb":116164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'1899","reported_seq":1945,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.694748+0000","last_change":"2024-04-25T11:05:39.694827+0000","last_active":"2024-04-25T11:05:39.694748+0000","last_peered":"2024-04-25T11:05:39.694748+0000","last_clean":"2024-04-25T11:05:39.694748+0000","last_became_active":"2024-04-25T10:38:59.358130+0000","last_became_peered":"2024-04-25T10:38:59.358130+0000","last_unstale":"2024-04-25T11:05:39.694748+0000","last_undegraded":"2024-04-25T11:05:39.694748+0000","last_fullsized":"2024-04-25T11:05:39.694748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1899","last_scrub_stamp":"2024-04-25T11:05:39.694533+0000","last_deep_scrub":"28'1899","last_deep_scrub_stamp":"2024-04-25T11:05:39.694533+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.694533+0000","objects_scrubbed":0,"log_size":1899,"log_dups_size":0,"ondisk_log_size":1899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:39.458321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5171","reported_seq":5219,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.484411+0000","last_change":"2024-04-25T11:05:42.484464+0000","last_active":"2024-04-25T11:05:42.484411+0000","last_peered":"2024-04-25T11:05:42.484411+0000","last_clean":"2024-04-25T11:05:42.484411+0000","last_became_active":"2024-04-25T10:38:58.369644+0000","last_became_peered":"2024-04-25T10:38:58.369644+0000","last_unstale":"2024-04-25T11:05:42.484411+0000","last_undegraded":"2024-04-25T11:05:42.484411+0000","last_fullsized":"2024-04-25T11:05:42.484411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5171","last_scrub_stamp":"2024-04-25T11:05:42.484325+0000","last_deep_scrub":"28'5171","last_deep_scrub_stamp":"2024-04-25T11:05:42.484325+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.484325+0000","objects_scrubbed":7,"log_size":5171,"log_dups_size":0,"ondisk_log_size":5171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:06.290929+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5172,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6464","reported_seq":6530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.913363+0000","last_change":"2024-04-25T11:05:47.913439+0000","last_active":"2024-04-25T11:05:47.913363+0000","last_peered":"2024-04-25T11:05:47.913363+0000","last_clean":"2024-04-25T11:05:47.913363+0000","last_became_active":"2024-04-25T10:39:03.425002+0000","last_became_peered":"2024-04-25T10:39:03.425002+0000","last_unstale":"2024-04-25T11:05:47.913363+0000","last_undegraded":"2024-04-25T11:05:47.913363+0000","last_fullsized":"2024-04-25T11:05:47.913363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6464","last_scrub_stamp":"2024-04-25T11:05:47.913145+0000","last_deep_scrub":"28'6464","last_deep_scrub_stamp":"2024-04-25T11:05:47.913145+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.913145+0000","objects_scrubbed":0,"log_size":6464,"log_dups_size":0,"ondisk_log_size":6464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:47.386941+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":6350,"num_write":4399,"num_write_kb":121932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'1922","reported_seq":1967,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:34.673075+0000","last_change":"2024-04-25T11:05:34.673075+0000","last_active":"2024-04-25T11:05:34.673075+0000","last_peered":"2024-04-25T11:05:34.673075+0000","last_clean":"2024-04-25T11:05:34.673075+0000","last_became_active":"2024-04-25T10:38:59.353871+0000","last_became_peered":"2024-04-25T10:38:59.353871+0000","last_unstale":"2024-04-25T11:05:34.673075+0000","last_undegraded":"2024-04-25T11:05:34.673075+0000","last_fullsized":"2024-04-25T11:05:34.673075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1922","last_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_deep_scrub":"28'1922","last_deep_scrub_stamp":"2024-04-25T11:05:34.672946+0000","last_clean_scrub_stamp":"2024-04-25T11:05:34.672946+0000","objects_scrubbed":0,"log_size":1922,"log_dups_size":0,"ondisk_log_size":1922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:11.794352+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5289","reported_seq":5337,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.179637+0000","last_change":"2024-04-25T11:05:41.179695+0000","last_active":"2024-04-25T11:05:41.179637+0000","last_peered":"2024-04-25T11:05:41.179637+0000","last_clean":"2024-04-25T11:05:41.179637+0000","last_became_active":"2024-04-25T10:38:58.368513+0000","last_became_peered":"2024-04-25T10:38:58.368513+0000","last_unstale":"2024-04-25T11:05:41.179637+0000","last_undegraded":"2024-04-25T11:05:41.179637+0000","last_fullsized":"2024-04-25T11:05:41.179637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5289","last_scrub_stamp":"2024-04-25T11:05:41.179528+0000","last_deep_scrub":"28'5289","last_deep_scrub_stamp":"2024-04-25T11:05:41.179528+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.179528+0000","objects_scrubbed":3,"log_size":5289,"log_dups_size":0,"ondisk_log_size":5289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:08.824304+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5291,"num_write_kb":39403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'6505","reported_seq":6850,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:50.219006+0000","last_change":"2024-04-25T11:05:50.219066+0000","last_active":"2024-04-25T11:05:50.219006+0000","last_peered":"2024-04-25T11:05:50.219006+0000","last_clean":"2024-04-25T11:05:50.219006+0000","last_became_active":"2024-04-25T10:39:03.402578+0000","last_became_peered":"2024-04-25T10:39:03.402578+0000","last_unstale":"2024-04-25T11:05:50.219006+0000","last_undegraded":"2024-04-25T11:05:50.219006+0000","last_fullsized":"2024-04-25T11:05:50.219006+0000","mapping_epoch":23,"log_start":"28'200","ondisk_log_start":"28'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6505","last_scrub_stamp":"2024-04-25T11:05:50.218877+0000","last_deep_scrub":"28'6505","last_deep_scrub_stamp":"2024-04-25T11:05:50.218877+0000","last_clean_scrub_stamp":"2024-04-25T11:05:50.218877+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:21:31.384604+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":304,"num_read_kb":77216,"num_write":4587,"num_write_kb":122819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'1886","reported_seq":1916,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.878514+0000","last_change":"2024-04-25T11:05:42.878514+0000","last_active":"2024-04-25T11:05:42.878514+0000","last_peered":"2024-04-25T11:05:42.878514+0000","last_clean":"2024-04-25T11:05:42.878514+0000","last_became_active":"2024-04-25T10:39:38.919743+0000","last_became_peered":"2024-04-25T10:39:38.919743+0000","last_unstale":"2024-04-25T11:05:42.878514+0000","last_undegraded":"2024-04-25T11:05:42.878514+0000","last_fullsized":"2024-04-25T11:05:42.878514+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1886","last_scrub_stamp":"2024-04-25T11:05:42.878389+0000","last_deep_scrub":"28'1886","last_deep_scrub_stamp":"2024-04-25T11:05:42.878389+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.878389+0000","objects_scrubbed":0,"log_size":1886,"log_dups_size":0,"ondisk_log_size":1886,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:05.057275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"28'4615","reported_seq":5275,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.498832+0000","last_change":"2024-04-25T11:05:40.498903+0000","last_active":"2024-04-25T11:05:40.498832+0000","last_peered":"2024-04-25T11:05:40.498832+0000","last_clean":"2024-04-25T11:05:40.498832+0000","last_became_active":"2024-04-25T10:38:58.372391+0000","last_became_peered":"2024-04-25T10:38:58.372391+0000","last_unstale":"2024-04-25T11:05:40.498832+0000","last_undegraded":"2024-04-25T11:05:40.498832+0000","last_fullsized":"2024-04-25T11:05:40.498832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4615","last_scrub_stamp":"2024-04-25T11:05:40.498675+0000","last_deep_scrub":"28'4615","last_deep_scrub_stamp":"2024-04-25T11:05:40.498675+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.498675+0000","objects_scrubbed":4,"log_size":4615,"log_dups_size":0,"ondisk_log_size":4615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:34.524405+0000","scrub_duration":79,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":613,"num_read_kb":4480,"num_write":4610,"num_write_kb":39070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'6806","reported_seq":7252,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.229370+0000","last_change":"2024-04-25T11:05:53.229457+0000","last_active":"2024-04-25T11:05:53.229370+0000","last_peered":"2024-04-25T11:05:53.229370+0000","last_clean":"2024-04-25T11:05:53.229370+0000","last_became_active":"2024-04-25T10:39:04.075973+0000","last_became_peered":"2024-04-25T10:39:04.075973+0000","last_unstale":"2024-04-25T11:05:53.229370+0000","last_undegraded":"2024-04-25T11:05:53.229370+0000","last_fullsized":"2024-04-25T11:05:53.229370+0000","mapping_epoch":23,"log_start":"28'501","ondisk_log_start":"28'501","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6806","last_scrub_stamp":"2024-04-25T11:05:53.229202+0000","last_deep_scrub":"28'6806","last_deep_scrub_stamp":"2024-04-25T11:05:53.229202+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.229202+0000","objects_scrubbed":0,"log_size":6305,"log_dups_size":0,"ondisk_log_size":6305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:19.958742+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":405,"num_read_kb":102870,"num_write":4777,"num_write_kb":128862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'6723","reported_seq":6868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.851402+0000","last_change":"2024-04-25T11:05:48.851456+0000","last_active":"2024-04-25T11:05:48.851402+0000","last_peered":"2024-04-25T11:05:48.851402+0000","last_clean":"2024-04-25T11:05:48.851402+0000","last_became_active":"2024-04-25T10:39:04.078068+0000","last_became_peered":"2024-04-25T10:39:04.078068+0000","last_unstale":"2024-04-25T11:05:48.851402+0000","last_undegraded":"2024-04-25T11:05:48.851402+0000","last_fullsized":"2024-04-25T11:05:48.851402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6723","last_scrub_stamp":"2024-04-25T11:05:48.851274+0000","last_deep_scrub":"28'6723","last_deep_scrub_stamp":"2024-04-25T11:05:48.851274+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.851274+0000","objects_scrubbed":0,"log_size":6723,"log_dups_size":0,"ondisk_log_size":6723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:42:01.015405+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":25908,"num_write":4788,"num_write_kb":128894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'1850","reported_seq":1896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:35.275167+0000","last_change":"2024-04-25T11:05:35.275167+0000","last_active":"2024-04-25T11:05:35.275167+0000","last_peered":"2024-04-25T11:05:35.275167+0000","last_clean":"2024-04-25T11:05:35.275167+0000","last_became_active":"2024-04-25T10:38:59.323846+0000","last_became_peered":"2024-04-25T10:38:59.323846+0000","last_unstale":"2024-04-25T11:05:35.275167+0000","last_undegraded":"2024-04-25T11:05:35.275167+0000","last_fullsized":"2024-04-25T11:05:35.275167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1850","last_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_deep_scrub":"28'1850","last_deep_scrub_stamp":"2024-04-25T11:05:35.275042+0000","last_clean_scrub_stamp":"2024-04-25T11:05:35.275042+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:12.396448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'7632","reported_seq":7680,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.194761+0000","last_change":"2024-04-25T11:05:42.194863+0000","last_active":"2024-04-25T11:05:42.194761+0000","last_peered":"2024-04-25T11:05:42.194761+0000","last_clean":"2024-04-25T11:05:42.194761+0000","last_became_active":"2024-04-25T10:38:58.368465+0000","last_became_peered":"2024-04-25T10:38:58.368465+0000","last_unstale":"2024-04-25T11:05:42.194761+0000","last_undegraded":"2024-04-25T11:05:42.194761+0000","last_fullsized":"2024-04-25T11:05:42.194761+0000","mapping_epoch":18,"log_start":"28'300","ondisk_log_start":"28'300","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7632","last_scrub_stamp":"2024-04-25T11:05:42.194499+0000","last_deep_scrub":"28'7632","last_deep_scrub_stamp":"2024-04-25T11:05:42.194499+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.194499+0000","objects_scrubbed":2,"log_size":7332,"log_dups_size":0,"ondisk_log_size":7332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:39.471542+0000","scrub_duration":83,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7616,"num_write_kb":60938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6433","reported_seq":6773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.256012+0000","last_change":"2024-04-25T11:05:49.256012+0000","last_active":"2024-04-25T11:05:49.256012+0000","last_peered":"2024-04-25T11:05:49.256012+0000","last_clean":"2024-04-25T11:05:49.256012+0000","last_became_active":"2024-04-25T10:39:03.415352+0000","last_became_peered":"2024-04-25T10:39:03.415352+0000","last_unstale":"2024-04-25T11:05:49.256012+0000","last_undegraded":"2024-04-25T11:05:49.256012+0000","last_fullsized":"2024-04-25T11:05:49.256012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6433","last_scrub_stamp":"2024-04-25T11:05:49.255715+0000","last_deep_scrub":"28'6433","last_deep_scrub_stamp":"2024-04-25T11:05:49.255715+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.255715+0000","objects_scrubbed":0,"log_size":6433,"log_dups_size":0,"ondisk_log_size":6433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:21.109802+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":297,"num_read_kb":75438,"num_write":4458,"num_write_kb":135113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'1942","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.129060+0000","last_change":"2024-04-25T11:05:45.129093+0000","last_active":"2024-04-25T11:05:45.129060+0000","last_peered":"2024-04-25T11:05:45.129060+0000","last_clean":"2024-04-25T11:05:45.129060+0000","last_became_active":"2024-04-25T10:38:59.336699+0000","last_became_peered":"2024-04-25T10:38:59.336699+0000","last_unstale":"2024-04-25T11:05:45.129060+0000","last_undegraded":"2024-04-25T11:05:45.129060+0000","last_fullsized":"2024-04-25T11:05:45.129060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1942","last_scrub_stamp":"2024-04-25T11:05:45.128948+0000","last_deep_scrub":"28'1942","last_deep_scrub_stamp":"2024-04-25T11:05:45.128948+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.128948+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:41:57.293080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'3994","reported_seq":4041,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:42.258819+0000","last_change":"2024-04-25T11:05:42.258866+0000","last_active":"2024-04-25T11:05:42.258819+0000","last_peered":"2024-04-25T11:05:42.258819+0000","last_clean":"2024-04-25T11:05:42.258819+0000","last_became_active":"2024-04-25T10:38:58.344075+0000","last_became_peered":"2024-04-25T10:38:58.344075+0000","last_unstale":"2024-04-25T11:05:42.258819+0000","last_undegraded":"2024-04-25T11:05:42.258819+0000","last_fullsized":"2024-04-25T11:05:42.258819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3994","last_scrub_stamp":"2024-04-25T11:05:42.258687+0000","last_deep_scrub":"28'3994","last_deep_scrub_stamp":"2024-04-25T11:05:42.258687+0000","last_clean_scrub_stamp":"2024-04-25T11:05:42.258687+0000","objects_scrubbed":5,"log_size":3994,"log_dups_size":0,"ondisk_log_size":3994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:41.732483+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3989,"num_write_kb":34647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4500,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'7623","reported_seq":7669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.646123+0000","last_change":"2024-04-25T11:05:38.646226+0000","last_active":"2024-04-25T11:05:38.646123+0000","last_peered":"2024-04-25T11:05:38.646123+0000","last_clean":"2024-04-25T11:05:38.646123+0000","last_became_active":"2024-04-25T10:38:58.359704+0000","last_became_peered":"2024-04-25T10:38:58.359704+0000","last_unstale":"2024-04-25T11:05:38.646123+0000","last_undegraded":"2024-04-25T11:05:38.646123+0000","last_fullsized":"2024-04-25T11:05:38.646123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7623","last_scrub_stamp":"2024-04-25T11:05:38.646006+0000","last_deep_scrub":"28'7623","last_deep_scrub_stamp":"2024-04-25T11:05:38.646006+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.646006+0000","objects_scrubbed":8,"log_size":7623,"log_dups_size":0,"ondisk_log_size":7623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:19.637891+0000","scrub_duration":167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7611,"num_write_kb":60921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7580,"num_omap_keys":15,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'1866","reported_seq":1910,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.805172+0000","last_change":"2024-04-25T11:05:43.805208+0000","last_active":"2024-04-25T11:05:43.805172+0000","last_peered":"2024-04-25T11:05:43.805172+0000","last_clean":"2024-04-25T11:05:43.805172+0000","last_became_active":"2024-04-25T10:38:59.357223+0000","last_became_peered":"2024-04-25T10:38:59.357223+0000","last_unstale":"2024-04-25T11:05:43.805172+0000","last_undegraded":"2024-04-25T11:05:43.805172+0000","last_fullsized":"2024-04-25T11:05:43.805172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1866","last_scrub_stamp":"2024-04-25T11:05:43.805055+0000","last_deep_scrub":"28'1866","last_deep_scrub_stamp":"2024-04-25T11:05:43.805055+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.805055+0000","objects_scrubbed":0,"log_size":1866,"log_dups_size":0,"ondisk_log_size":1866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:15.659142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'6829","reported_seq":6922,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.888014+0000","last_change":"2024-04-25T11:05:41.888050+0000","last_active":"2024-04-25T11:05:41.888014+0000","last_peered":"2024-04-25T11:05:41.888014+0000","last_clean":"2024-04-25T11:05:41.888014+0000","last_became_active":"2024-04-25T10:39:03.395308+0000","last_became_peered":"2024-04-25T10:39:03.395308+0000","last_unstale":"2024-04-25T11:05:41.888014+0000","last_undegraded":"2024-04-25T11:05:41.888014+0000","last_fullsized":"2024-04-25T11:05:41.888014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6829","last_scrub_stamp":"2024-04-25T11:05:41.887885+0000","last_deep_scrub":"28'6829","last_deep_scrub_stamp":"2024-04-25T11:05:41.887885+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.887885+0000","objects_scrubbed":0,"log_size":6829,"log_dups_size":0,"ondisk_log_size":6829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:55.669713+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":13462,"num_write":4770,"num_write_kb":143218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5979","reported_seq":6025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.322908+0000","last_change":"2024-04-25T11:05:43.322957+0000","last_active":"2024-04-25T11:05:43.322908+0000","last_peered":"2024-04-25T11:05:43.322908+0000","last_clean":"2024-04-25T11:05:43.322908+0000","last_became_active":"2024-04-25T10:38:58.354199+0000","last_became_peered":"2024-04-25T10:38:58.354199+0000","last_unstale":"2024-04-25T11:05:43.322908+0000","last_undegraded":"2024-04-25T11:05:43.322908+0000","last_fullsized":"2024-04-25T11:05:43.322908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5979","last_scrub_stamp":"2024-04-25T11:05:43.322821+0000","last_deep_scrub":"28'5979","last_deep_scrub_stamp":"2024-04-25T11:05:43.322821+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.322821+0000","objects_scrubbed":8,"log_size":5979,"log_dups_size":0,"ondisk_log_size":5979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:38.556844+0000","scrub_duration":183,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166845,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5967,"num_write_kb":56105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'1925","reported_seq":1970,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.716295+0000","last_change":"2024-04-25T11:05:38.716370+0000","last_active":"2024-04-25T11:05:38.716295+0000","last_peered":"2024-04-25T11:05:38.716295+0000","last_clean":"2024-04-25T11:05:38.716295+0000","last_became_active":"2024-04-25T10:38:59.355207+0000","last_became_peered":"2024-04-25T10:38:59.355207+0000","last_unstale":"2024-04-25T11:05:38.716295+0000","last_undegraded":"2024-04-25T11:05:38.716295+0000","last_fullsized":"2024-04-25T11:05:38.716295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1925","last_scrub_stamp":"2024-04-25T11:05:38.716093+0000","last_deep_scrub":"28'1925","last_deep_scrub_stamp":"2024-04-25T11:05:38.716093+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.716093+0000","objects_scrubbed":0,"log_size":1925,"log_dups_size":0,"ondisk_log_size":1925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:25.323811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7364","reported_seq":7926,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.196776+0000","last_change":"2024-04-25T11:05:51.196814+0000","last_active":"2024-04-25T11:05:51.196776+0000","last_peered":"2024-04-25T11:05:51.196776+0000","last_clean":"2024-04-25T11:05:51.196776+0000","last_became_active":"2024-04-25T10:39:03.406894+0000","last_became_peered":"2024-04-25T10:39:03.406894+0000","last_unstale":"2024-04-25T11:05:51.196776+0000","last_undegraded":"2024-04-25T11:05:51.196776+0000","last_fullsized":"2024-04-25T11:05:51.196776+0000","mapping_epoch":23,"log_start":"28'1034","ondisk_log_start":"28'1034","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7364","last_scrub_stamp":"2024-04-25T11:05:51.196643+0000","last_deep_scrub":"28'7364","last_deep_scrub_stamp":"2024-04-25T11:05:51.196643+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.196643+0000","objects_scrubbed":0,"log_size":6330,"log_dups_size":0,"ondisk_log_size":6330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:49:29.502502+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":132588,"num_write":5337,"num_write_kb":124832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'1843","reported_seq":1890,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.305876+0000","last_change":"2024-04-25T11:05:46.305876+0000","last_active":"2024-04-25T11:05:46.305876+0000","last_peered":"2024-04-25T11:05:46.305876+0000","last_clean":"2024-04-25T11:05:46.305876+0000","last_became_active":"2024-04-25T10:38:59.345941+0000","last_became_peered":"2024-04-25T10:38:59.345941+0000","last_unstale":"2024-04-25T11:05:46.305876+0000","last_undegraded":"2024-04-25T11:05:46.305876+0000","last_fullsized":"2024-04-25T11:05:46.305876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1843","last_scrub_stamp":"2024-04-25T11:05:46.305599+0000","last_deep_scrub":"28'1843","last_deep_scrub_stamp":"2024-04-25T11:05:46.305599+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.305599+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:11.562584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'1947","reported_seq":1995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.777161+0000","last_change":"2024-04-25T11:05:39.777161+0000","last_active":"2024-04-25T11:05:39.777161+0000","last_peered":"2024-04-25T11:05:39.777161+0000","last_clean":"2024-04-25T11:05:39.777161+0000","last_became_active":"2024-04-25T10:38:59.332052+0000","last_became_peered":"2024-04-25T10:38:59.332052+0000","last_unstale":"2024-04-25T11:05:39.777161+0000","last_undegraded":"2024-04-25T11:05:39.777161+0000","last_fullsized":"2024-04-25T11:05:39.777161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1947","last_scrub_stamp":"2024-04-25T11:05:39.776963+0000","last_deep_scrub":"28'1947","last_deep_scrub_stamp":"2024-04-25T11:05:39.776963+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.776963+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:30:40.932212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1853","reported_seq":1901,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.164486+0000","last_change":"2024-04-25T11:05:45.164486+0000","last_active":"2024-04-25T11:05:45.164486+0000","last_peered":"2024-04-25T11:05:45.164486+0000","last_clean":"2024-04-25T11:05:45.164486+0000","last_became_active":"2024-04-25T10:38:59.337709+0000","last_became_peered":"2024-04-25T10:38:59.337709+0000","last_unstale":"2024-04-25T11:05:45.164486+0000","last_undegraded":"2024-04-25T11:05:45.164486+0000","last_fullsized":"2024-04-25T11:05:45.164486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1853","last_scrub_stamp":"2024-04-25T11:05:45.164325+0000","last_deep_scrub":"28'1853","last_deep_scrub_stamp":"2024-04-25T11:05:45.164325+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.164325+0000","objects_scrubbed":0,"log_size":1853,"log_dups_size":0,"ondisk_log_size":1853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:06.921534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'1943","reported_seq":1995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.801767+0000","last_change":"2024-04-25T11:05:49.801767+0000","last_active":"2024-04-25T11:05:49.801767+0000","last_peered":"2024-04-25T11:05:49.801767+0000","last_clean":"2024-04-25T11:05:49.801767+0000","last_became_active":"2024-04-25T10:39:38.920777+0000","last_became_peered":"2024-04-25T10:39:38.920777+0000","last_unstale":"2024-04-25T11:05:49.801767+0000","last_undegraded":"2024-04-25T11:05:49.801767+0000","last_fullsized":"2024-04-25T11:05:49.801767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:49.801619+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:49.801619+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.801619+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:05.636610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1942","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:39.168932+0000","last_change":"2024-04-25T11:05:39.168964+0000","last_active":"2024-04-25T11:05:39.168932+0000","last_peered":"2024-04-25T11:05:39.168932+0000","last_clean":"2024-04-25T11:05:39.168932+0000","last_became_active":"2024-04-25T10:38:59.361397+0000","last_became_peered":"2024-04-25T10:38:59.361397+0000","last_unstale":"2024-04-25T11:05:39.168932+0000","last_undegraded":"2024-04-25T11:05:39.168932+0000","last_fullsized":"2024-04-25T11:05:39.168932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1942","last_scrub_stamp":"2024-04-25T11:05:39.168824+0000","last_deep_scrub":"28'1942","last_deep_scrub_stamp":"2024-04-25T11:05:39.168824+0000","last_clean_scrub_stamp":"2024-04-25T11:05:39.168824+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:09.867682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1847","reported_seq":1894,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.335562+0000","last_change":"2024-04-25T11:05:36.335608+0000","last_active":"2024-04-25T11:05:36.335562+0000","last_peered":"2024-04-25T11:05:36.335562+0000","last_clean":"2024-04-25T11:05:36.335562+0000","last_became_active":"2024-04-25T10:38:59.324494+0000","last_became_peered":"2024-04-25T10:38:59.324494+0000","last_unstale":"2024-04-25T11:05:36.335562+0000","last_undegraded":"2024-04-25T11:05:36.335562+0000","last_fullsized":"2024-04-25T11:05:36.335562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1847","last_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_deep_scrub":"28'1847","last_deep_scrub_stamp":"2024-04-25T11:05:36.335456+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.335456+0000","objects_scrubbed":0,"log_size":1847,"log_dups_size":0,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.358886+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'1948","reported_seq":1994,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.268707+0000","last_change":"2024-04-25T11:05:47.268780+0000","last_active":"2024-04-25T11:05:47.268707+0000","last_peered":"2024-04-25T11:05:47.268707+0000","last_clean":"2024-04-25T11:05:47.268707+0000","last_became_active":"2024-04-25T10:38:59.353378+0000","last_became_peered":"2024-04-25T10:38:59.353378+0000","last_unstale":"2024-04-25T11:05:47.268707+0000","last_undegraded":"2024-04-25T11:05:47.268707+0000","last_fullsized":"2024-04-25T11:05:47.268707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1948","last_scrub_stamp":"2024-04-25T11:05:47.268506+0000","last_deep_scrub":"28'1948","last_deep_scrub_stamp":"2024-04-25T11:05:47.268506+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.268506+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:11.075110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'1915","reported_seq":1961,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:36.112884+0000","last_change":"2024-04-25T11:05:36.112913+0000","last_active":"2024-04-25T11:05:36.112884+0000","last_peered":"2024-04-25T11:05:36.112884+0000","last_clean":"2024-04-25T11:05:36.112884+0000","last_became_active":"2024-04-25T10:38:59.354670+0000","last_became_peered":"2024-04-25T10:38:59.354670+0000","last_unstale":"2024-04-25T11:05:36.112884+0000","last_undegraded":"2024-04-25T11:05:36.112884+0000","last_fullsized":"2024-04-25T11:05:36.112884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1915","last_scrub_stamp":"2024-04-25T11:05:36.112788+0000","last_deep_scrub":"28'1915","last_deep_scrub_stamp":"2024-04-25T11:05:36.112788+0000","last_clean_scrub_stamp":"2024-04-25T11:05:36.112788+0000","objects_scrubbed":0,"log_size":1915,"log_dups_size":0,"ondisk_log_size":1915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:33.389830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'1873","reported_seq":1920,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.129386+0000","last_change":"2024-04-25T11:05:46.129462+0000","last_active":"2024-04-25T11:05:46.129386+0000","last_peered":"2024-04-25T11:05:46.129386+0000","last_clean":"2024-04-25T11:05:46.129386+0000","last_became_active":"2024-04-25T10:38:59.337915+0000","last_became_peered":"2024-04-25T10:38:59.337915+0000","last_unstale":"2024-04-25T11:05:46.129386+0000","last_undegraded":"2024-04-25T11:05:46.129386+0000","last_fullsized":"2024-04-25T11:05:46.129386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1873","last_scrub_stamp":"2024-04-25T11:05:46.129186+0000","last_deep_scrub":"28'1873","last_deep_scrub_stamp":"2024-04-25T11:05:46.129186+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.129186+0000","objects_scrubbed":0,"log_size":1873,"log_dups_size":0,"ondisk_log_size":1873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:36:45.726435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'1913","reported_seq":1959,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.142038+0000","last_change":"2024-04-25T11:05:37.142038+0000","last_active":"2024-04-25T11:05:37.142038+0000","last_peered":"2024-04-25T11:05:37.142038+0000","last_clean":"2024-04-25T11:05:37.142038+0000","last_became_active":"2024-04-25T10:38:59.359445+0000","last_became_peered":"2024-04-25T10:38:59.359445+0000","last_unstale":"2024-04-25T11:05:37.142038+0000","last_undegraded":"2024-04-25T11:05:37.142038+0000","last_fullsized":"2024-04-25T11:05:37.142038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1913","last_scrub_stamp":"2024-04-25T11:05:37.141855+0000","last_deep_scrub":"28'1913","last_deep_scrub_stamp":"2024-04-25T11:05:37.141855+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.141855+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:02.398839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'1928","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.187760+0000","last_change":"2024-04-25T11:05:49.187760+0000","last_active":"2024-04-25T11:05:49.187760+0000","last_peered":"2024-04-25T11:05:49.187760+0000","last_clean":"2024-04-25T11:05:49.187760+0000","last_became_active":"2024-04-25T10:38:59.352438+0000","last_became_peered":"2024-04-25T10:38:59.352438+0000","last_unstale":"2024-04-25T11:05:49.187760+0000","last_undegraded":"2024-04-25T11:05:49.187760+0000","last_fullsized":"2024-04-25T11:05:49.187760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1928","last_scrub_stamp":"2024-04-25T11:05:49.187600+0000","last_deep_scrub":"28'1928","last_deep_scrub_stamp":"2024-04-25T11:05:49.187600+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.187600+0000","objects_scrubbed":0,"log_size":1928,"log_dups_size":0,"ondisk_log_size":1928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:30.328300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'1930","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.801232+0000","last_change":"2024-04-25T11:05:40.801232+0000","last_active":"2024-04-25T11:05:40.801232+0000","last_peered":"2024-04-25T11:05:40.801232+0000","last_clean":"2024-04-25T11:05:40.801232+0000","last_became_active":"2024-04-25T10:38:59.353723+0000","last_became_peered":"2024-04-25T10:38:59.353723+0000","last_unstale":"2024-04-25T11:05:40.801232+0000","last_undegraded":"2024-04-25T11:05:40.801232+0000","last_fullsized":"2024-04-25T11:05:40.801232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1930","last_scrub_stamp":"2024-04-25T11:05:40.801053+0000","last_deep_scrub":"28'1930","last_deep_scrub_stamp":"2024-04-25T11:05:40.801053+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.801053+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:06.058037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'1903","reported_seq":1949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.262941+0000","last_change":"2024-04-25T11:05:48.262941+0000","last_active":"2024-04-25T11:05:48.262941+0000","last_peered":"2024-04-25T11:05:48.262941+0000","last_clean":"2024-04-25T11:05:48.262941+0000","last_became_active":"2024-04-25T10:38:59.365886+0000","last_became_peered":"2024-04-25T10:38:59.365886+0000","last_unstale":"2024-04-25T11:05:48.262941+0000","last_undegraded":"2024-04-25T11:05:48.262941+0000","last_fullsized":"2024-04-25T11:05:48.262941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1903","last_scrub_stamp":"2024-04-25T11:05:48.262651+0000","last_deep_scrub":"28'1903","last_deep_scrub_stamp":"2024-04-25T11:05:48.262651+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.262651+0000","objects_scrubbed":0,"log_size":1903,"log_dups_size":0,"ondisk_log_size":1903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:18.961509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'1959","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.340965+0000","last_change":"2024-04-25T11:05:48.340965+0000","last_active":"2024-04-25T11:05:48.340965+0000","last_peered":"2024-04-25T11:05:48.340965+0000","last_clean":"2024-04-25T11:05:48.340965+0000","last_became_active":"2024-04-25T10:38:59.360481+0000","last_became_peered":"2024-04-25T10:38:59.360481+0000","last_unstale":"2024-04-25T11:05:48.340965+0000","last_undegraded":"2024-04-25T11:05:48.340965+0000","last_fullsized":"2024-04-25T11:05:48.340965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-04-25T11:05:48.340572+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-04-25T11:05:48.340572+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.340572+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:47.581463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1860","reported_seq":1906,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:40.823169+0000","last_change":"2024-04-25T11:05:40.823201+0000","last_active":"2024-04-25T11:05:40.823169+0000","last_peered":"2024-04-25T11:05:40.823169+0000","last_clean":"2024-04-25T11:05:40.823169+0000","last_became_active":"2024-04-25T10:38:59.342872+0000","last_became_peered":"2024-04-25T10:38:59.342872+0000","last_unstale":"2024-04-25T11:05:40.823169+0000","last_undegraded":"2024-04-25T11:05:40.823169+0000","last_fullsized":"2024-04-25T11:05:40.823169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1860","last_scrub_stamp":"2024-04-25T11:05:40.823065+0000","last_deep_scrub":"28'1860","last_deep_scrub_stamp":"2024-04-25T11:05:40.823065+0000","last_clean_scrub_stamp":"2024-04-25T11:05:40.823065+0000","objects_scrubbed":0,"log_size":1860,"log_dups_size":0,"ondisk_log_size":1860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:45.623650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'1907","reported_seq":1953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:51.268918+0000","last_change":"2024-04-25T11:05:51.268995+0000","last_active":"2024-04-25T11:05:51.268918+0000","last_peered":"2024-04-25T11:05:51.268918+0000","last_clean":"2024-04-25T11:05:51.268918+0000","last_became_active":"2024-04-25T10:38:59.370692+0000","last_became_peered":"2024-04-25T10:38:59.370692+0000","last_unstale":"2024-04-25T11:05:51.268918+0000","last_undegraded":"2024-04-25T11:05:51.268918+0000","last_fullsized":"2024-04-25T11:05:51.268918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1907","last_scrub_stamp":"2024-04-25T11:05:51.268697+0000","last_deep_scrub":"28'1907","last_deep_scrub_stamp":"2024-04-25T11:05:51.268697+0000","last_clean_scrub_stamp":"2024-04-25T11:05:51.268697+0000","objects_scrubbed":0,"log_size":1907,"log_dups_size":0,"ondisk_log_size":1907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:07.103688+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'1838","reported_seq":1884,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.117595+0000","last_change":"2024-04-25T11:05:47.117675+0000","last_active":"2024-04-25T11:05:47.117595+0000","last_peered":"2024-04-25T11:05:47.117595+0000","last_clean":"2024-04-25T11:05:47.117595+0000","last_became_active":"2024-04-25T10:38:59.340759+0000","last_became_peered":"2024-04-25T10:38:59.340759+0000","last_unstale":"2024-04-25T11:05:47.117595+0000","last_undegraded":"2024-04-25T11:05:47.117595+0000","last_fullsized":"2024-04-25T11:05:47.117595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1838","last_scrub_stamp":"2024-04-25T11:05:47.117364+0000","last_deep_scrub":"28'1838","last_deep_scrub_stamp":"2024-04-25T11:05:47.117364+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.117364+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:46.591160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"28'1959","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.391401+0000","last_change":"2024-04-25T11:05:46.391437+0000","last_active":"2024-04-25T11:05:46.391401+0000","last_peered":"2024-04-25T11:05:46.391401+0000","last_clean":"2024-04-25T11:05:46.391401+0000","last_became_active":"2024-04-25T10:38:59.359978+0000","last_became_peered":"2024-04-25T10:38:59.359978+0000","last_unstale":"2024-04-25T11:05:46.391401+0000","last_undegraded":"2024-04-25T11:05:46.391401+0000","last_fullsized":"2024-04-25T11:05:46.391401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-04-25T11:05:46.391278+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-04-25T11:05:46.391278+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.391278+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:03:59.413976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'1864","reported_seq":1909,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:38.726790+0000","last_change":"2024-04-25T11:05:38.726820+0000","last_active":"2024-04-25T11:05:38.726790+0000","last_peered":"2024-04-25T11:05:38.726790+0000","last_clean":"2024-04-25T11:05:38.726790+0000","last_became_active":"2024-04-25T10:38:59.339577+0000","last_became_peered":"2024-04-25T10:38:59.339577+0000","last_unstale":"2024-04-25T11:05:38.726790+0000","last_undegraded":"2024-04-25T11:05:38.726790+0000","last_fullsized":"2024-04-25T11:05:38.726790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1864","last_scrub_stamp":"2024-04-25T11:05:38.726698+0000","last_deep_scrub":"28'1864","last_deep_scrub_stamp":"2024-04-25T11:05:38.726698+0000","last_clean_scrub_stamp":"2024-04-25T11:05:38.726698+0000","objects_scrubbed":0,"log_size":1864,"log_dups_size":0,"ondisk_log_size":1864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:21.675410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'1879","reported_seq":1924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.129720+0000","last_change":"2024-04-25T11:05:48.129833+0000","last_active":"2024-04-25T11:05:48.129720+0000","last_peered":"2024-04-25T11:05:48.129720+0000","last_clean":"2024-04-25T11:05:48.129720+0000","last_became_active":"2024-04-25T10:38:59.340834+0000","last_became_peered":"2024-04-25T10:38:59.340834+0000","last_unstale":"2024-04-25T11:05:48.129720+0000","last_undegraded":"2024-04-25T11:05:48.129720+0000","last_fullsized":"2024-04-25T11:05:48.129720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1879","last_scrub_stamp":"2024-04-25T11:05:48.129587+0000","last_deep_scrub":"28'1879","last_deep_scrub_stamp":"2024-04-25T11:05:48.129587+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.129587+0000","objects_scrubbed":0,"log_size":1879,"log_dups_size":0,"ondisk_log_size":1879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:57.661186+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'1816","reported_seq":1862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:41.741409+0000","last_change":"2024-04-25T11:05:41.741476+0000","last_active":"2024-04-25T11:05:41.741409+0000","last_peered":"2024-04-25T11:05:41.741409+0000","last_clean":"2024-04-25T11:05:41.741409+0000","last_became_active":"2024-04-25T10:38:59.366584+0000","last_became_peered":"2024-04-25T10:38:59.366584+0000","last_unstale":"2024-04-25T11:05:41.741409+0000","last_undegraded":"2024-04-25T11:05:41.741409+0000","last_fullsized":"2024-04-25T11:05:41.741409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1816","last_scrub_stamp":"2024-04-25T11:05:41.741218+0000","last_deep_scrub":"28'1816","last_deep_scrub_stamp":"2024-04-25T11:05:41.741218+0000","last_clean_scrub_stamp":"2024-04-25T11:05:41.741218+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:21.445623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'1835","reported_seq":1880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:43.416959+0000","last_change":"2024-04-25T11:05:43.417042+0000","last_active":"2024-04-25T11:05:43.416959+0000","last_peered":"2024-04-25T11:05:43.416959+0000","last_clean":"2024-04-25T11:05:43.416959+0000","last_became_active":"2024-04-25T10:38:59.349095+0000","last_became_peered":"2024-04-25T10:38:59.349095+0000","last_unstale":"2024-04-25T11:05:43.416959+0000","last_undegraded":"2024-04-25T11:05:43.416959+0000","last_fullsized":"2024-04-25T11:05:43.416959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1835","last_scrub_stamp":"2024-04-25T11:05:43.416736+0000","last_deep_scrub":"28'1835","last_deep_scrub_stamp":"2024-04-25T11:05:43.416736+0000","last_clean_scrub_stamp":"2024-04-25T11:05:43.416736+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:51.970800+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'1953","reported_seq":1998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.344297+0000","last_change":"2024-04-25T11:05:45.344358+0000","last_active":"2024-04-25T11:05:45.344297+0000","last_peered":"2024-04-25T11:05:45.344297+0000","last_clean":"2024-04-25T11:05:45.344297+0000","last_became_active":"2024-04-25T10:38:59.350793+0000","last_became_peered":"2024-04-25T10:38:59.350793+0000","last_unstale":"2024-04-25T11:05:45.344297+0000","last_undegraded":"2024-04-25T11:05:45.344297+0000","last_fullsized":"2024-04-25T11:05:45.344297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1953","last_scrub_stamp":"2024-04-25T11:05:45.344123+0000","last_deep_scrub":"28'1953","last_deep_scrub_stamp":"2024-04-25T11:05:45.344123+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.344123+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.621166+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'1930","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:53.329741+0000","last_change":"2024-04-25T11:05:53.329811+0000","last_active":"2024-04-25T11:05:53.329741+0000","last_peered":"2024-04-25T11:05:53.329741+0000","last_clean":"2024-04-25T11:05:53.329741+0000","last_became_active":"2024-04-25T10:38:59.373223+0000","last_became_peered":"2024-04-25T10:38:59.373223+0000","last_unstale":"2024-04-25T11:05:53.329741+0000","last_undegraded":"2024-04-25T11:05:53.329741+0000","last_fullsized":"2024-04-25T11:05:53.329741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1930","last_scrub_stamp":"2024-04-25T11:05:53.329540+0000","last_deep_scrub":"28'1930","last_deep_scrub_stamp":"2024-04-25T11:05:53.329540+0000","last_clean_scrub_stamp":"2024-04-25T11:05:53.329540+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:09.164531+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'1891","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:46.112286+0000","last_change":"2024-04-25T11:05:46.112348+0000","last_active":"2024-04-25T11:05:46.112286+0000","last_peered":"2024-04-25T11:05:46.112286+0000","last_clean":"2024-04-25T11:05:46.112286+0000","last_became_active":"2024-04-25T10:38:59.338461+0000","last_became_peered":"2024-04-25T10:38:59.338461+0000","last_unstale":"2024-04-25T11:05:46.112286+0000","last_undegraded":"2024-04-25T11:05:46.112286+0000","last_fullsized":"2024-04-25T11:05:46.112286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1891","last_scrub_stamp":"2024-04-25T11:05:46.112159+0000","last_deep_scrub":"28'1891","last_deep_scrub_stamp":"2024-04-25T11:05:46.112159+0000","last_clean_scrub_stamp":"2024-04-25T11:05:46.112159+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:01.947150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'1855","reported_seq":1899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:47.324909+0000","last_change":"2024-04-25T11:05:47.324953+0000","last_active":"2024-04-25T11:05:47.324909+0000","last_peered":"2024-04-25T11:05:47.324909+0000","last_clean":"2024-04-25T11:05:47.324909+0000","last_became_active":"2024-04-25T10:38:59.355013+0000","last_became_peered":"2024-04-25T10:38:59.355013+0000","last_unstale":"2024-04-25T11:05:47.324909+0000","last_undegraded":"2024-04-25T11:05:47.324909+0000","last_fullsized":"2024-04-25T11:05:47.324909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1855","last_scrub_stamp":"2024-04-25T11:05:47.324802+0000","last_deep_scrub":"28'1855","last_deep_scrub_stamp":"2024-04-25T11:05:47.324802+0000","last_clean_scrub_stamp":"2024-04-25T11:05:47.324802+0000","objects_scrubbed":0,"log_size":1855,"log_dups_size":0,"ondisk_log_size":1855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:19.178889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1824","reported_seq":1869,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:48.162051+0000","last_change":"2024-04-25T11:05:48.162162+0000","last_active":"2024-04-25T11:05:48.162051+0000","last_peered":"2024-04-25T11:05:48.162051+0000","last_clean":"2024-04-25T11:05:48.162051+0000","last_became_active":"2024-04-25T10:38:59.337269+0000","last_became_peered":"2024-04-25T10:38:59.337269+0000","last_unstale":"2024-04-25T11:05:48.162051+0000","last_undegraded":"2024-04-25T11:05:48.162051+0000","last_fullsized":"2024-04-25T11:05:48.162051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1824","last_scrub_stamp":"2024-04-25T11:05:48.161849+0000","last_deep_scrub":"28'1824","last_deep_scrub_stamp":"2024-04-25T11:05:48.161849+0000","last_clean_scrub_stamp":"2024-04-25T11:05:48.161849+0000","objects_scrubbed":0,"log_size":1824,"log_dups_size":0,"ondisk_log_size":1824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:43.395872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'1920","reported_seq":1964,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:49.383987+0000","last_change":"2024-04-25T11:05:49.384038+0000","last_active":"2024-04-25T11:05:49.383987+0000","last_peered":"2024-04-25T11:05:49.383987+0000","last_clean":"2024-04-25T11:05:49.383987+0000","last_became_active":"2024-04-25T10:38:59.361270+0000","last_became_peered":"2024-04-25T10:38:59.361270+0000","last_unstale":"2024-04-25T11:05:49.383987+0000","last_undegraded":"2024-04-25T11:05:49.383987+0000","last_fullsized":"2024-04-25T11:05:49.383987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1920","last_scrub_stamp":"2024-04-25T11:05:49.383869+0000","last_deep_scrub":"28'1920","last_deep_scrub_stamp":"2024-04-25T11:05:49.383869+0000","last_clean_scrub_stamp":"2024-04-25T11:05:49.383869+0000","objects_scrubbed":0,"log_size":1920,"log_dups_size":0,"ondisk_log_size":1920,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:48.857665+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'1943","reported_seq":1991,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:44.152434+0000","last_change":"2024-04-25T11:05:44.152572+0000","last_active":"2024-04-25T11:05:44.152434+0000","last_peered":"2024-04-25T11:05:44.152434+0000","last_clean":"2024-04-25T11:05:44.152434+0000","last_became_active":"2024-04-25T10:38:59.337918+0000","last_became_peered":"2024-04-25T10:38:59.337918+0000","last_unstale":"2024-04-25T11:05:44.152434+0000","last_undegraded":"2024-04-25T11:05:44.152434+0000","last_fullsized":"2024-04-25T11:05:44.152434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1943","last_scrub_stamp":"2024-04-25T11:05:44.152096+0000","last_deep_scrub":"28'1943","last_deep_scrub_stamp":"2024-04-25T11:05:44.152096+0000","last_clean_scrub_stamp":"2024-04-25T11:05:44.152096+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:29:20.611446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'1984","reported_seq":2031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:37.743495+0000","last_change":"2024-04-25T11:05:37.743495+0000","last_active":"2024-04-25T11:05:37.743495+0000","last_peered":"2024-04-25T11:05:37.743495+0000","last_clean":"2024-04-25T11:05:37.743495+0000","last_became_active":"2024-04-25T10:38:59.335526+0000","last_became_peered":"2024-04-25T10:38:59.335526+0000","last_unstale":"2024-04-25T11:05:37.743495+0000","last_undegraded":"2024-04-25T11:05:37.743495+0000","last_fullsized":"2024-04-25T11:05:37.743495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1984","last_scrub_stamp":"2024-04-25T11:05:37.743364+0000","last_deep_scrub":"28'1984","last_deep_scrub_stamp":"2024-04-25T11:05:37.743364+0000","last_clean_scrub_stamp":"2024-04-25T11:05:37.743364+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:46.297429+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1848","reported_seq":1896,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:45.366625+0000","last_change":"2024-04-25T11:05:45.366625+0000","last_active":"2024-04-25T11:05:45.366625+0000","last_peered":"2024-04-25T11:05:45.366625+0000","last_clean":"2024-04-25T11:05:45.366625+0000","last_became_active":"2024-04-25T10:38:59.339555+0000","last_became_peered":"2024-04-25T10:38:59.339555+0000","last_unstale":"2024-04-25T11:05:45.366625+0000","last_undegraded":"2024-04-25T11:05:45.366625+0000","last_fullsized":"2024-04-25T11:05:45.366625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1848","last_scrub_stamp":"2024-04-25T11:05:45.366399+0000","last_deep_scrub":"28'1848","last_deep_scrub_stamp":"2024-04-25T11:05:45.366399+0000","last_clean_scrub_stamp":"2024-04-25T11:05:45.366399+0000","objects_scrubbed":0,"log_size":1848,"log_dups_size":0,"ondisk_log_size":1848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:44.607291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'1830","reported_seq":1877,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T11:05:54.326583+0000","last_change":"2024-04-25T11:05:54.326583+0000","last_active":"2024-04-25T11:05:54.326583+0000","last_peered":"2024-04-25T11:05:54.326583+0000","last_clean":"2024-04-25T11:05:54.326583+0000","last_became_active":"2024-04-25T10:38:59.375046+0000","last_became_peered":"2024-04-25T10:38:59.375046+0000","last_unstale":"2024-04-25T11:05:54.326583+0000","last_undegraded":"2024-04-25T11:05:54.326583+0000","last_fullsized":"2024-04-25T11:05:54.326583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1830","last_scrub_stamp":"2024-04-25T11:05:54.326397+0000","last_deep_scrub":"28'1830","last_deep_scrub_stamp":"2024-04-25T11:05:54.326397+0000","last_clean_scrub_stamp":"2024-04-25T11:05:54.326397+0000","objects_scrubbed":0,"log_size":1830,"log_dups_size":0,"ondisk_log_size":1830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:13.541793+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5113,"num_read_kb":1298702,"num_write":151821,"num_write_kb":4126830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212967,"ondisk_log_size":212967,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121562,"ondisk_log_size":121562,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":242390766,"num_objects":136,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":136,"num_whiteouts":0,"num_read":2754,"num_read_kb":14599,"num_write":146441,"num_write_kb":1171337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":82340,"num_omap_keys":164,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":304652288,"data_stored":484781532,"data_compressed":55811378,"data_compressed_allocated":82255872,"data_compressed_original":262545408,"omap_allocated":0,"internal_metadata":0},"log_size":143259,"ondisk_log_size":143259,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66962,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575182,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":756724,"kb_used_data":35564,"kb_used_omap":1,"kb_used_meta":721150,"kb_avail":93615116,"statfs":{"total":96636764160,"available":95861878784,"internally_reserved":0,"allocated":36417536,"data_stored":55244212,"data_compressed":6002479,"data_compressed_allocated":9076736,"data_compressed_original":28102656,"omap_allocated":1590,"internal_metadata":738458058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575181,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806104,"kb_used_data":53072,"kb_used_omap":1,"kb_used_meta":753022,"kb_avail":93565736,"statfs":{"total":96636764160,"available":95811313664,"internally_reserved":0,"allocated":54345728,"data_stored":87324364,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":1594,"internal_metadata":771094982},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575181,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757208,"kb_used_data":36240,"kb_used_omap":1,"kb_used_meta":720958,"kb_avail":93614632,"statfs":{"total":96636764160,"available":95861383168,"internally_reserved":0,"allocated":37109760,"data_stored":58847811,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":1595,"internal_metadata":738261445},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575180,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":744504,"kb_used_data":41520,"kb_used_omap":1,"kb_used_meta":702974,"kb_avail":93627336,"statfs":{"total":96636764160,"available":95874392064,"internally_reserved":0,"allocated":42516480,"data_stored":67236154,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":1594,"internal_metadata":719845830},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575180,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":856044,"kb_used_data":62884,"kb_used_omap":1,"kb_used_meta":793150,"kb_avail":93515796,"statfs":{"total":96636764160,"available":95760175104,"internally_reserved":0,"allocated":64393216,"data_stored":103540213,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":1593,"internal_metadata":812186055},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575181,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":467156,"kb_used_data":25100,"kb_used_omap":1,"kb_used_meta":442046,"kb_avail":93904684,"statfs":{"total":96636764160,"available":96158396416,"internally_reserved":0,"allocated":25702400,"data_stored":42070035,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":1595,"internal_metadata":452655557},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575181,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":806148,"kb_used_data":21244,"kb_used_omap":1,"kb_used_meta":784894,"kb_avail":93565692,"statfs":{"total":96636764160,"available":95811268608,"internally_reserved":0,"allocated":21753856,"data_stored":34242954,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":1595,"internal_metadata":803731909},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575182,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":569032,"kb_used_data":24384,"kb_used_omap":1,"kb_used_meta":544638,"kb_avail":93802808,"statfs":{"total":96636764160,"available":96054075392,"internally_reserved":0,"allocated":24969216,"data_stored":38465941,"data_compressed":4403067,"data_compressed_allocated":6627328,"data_compressed_original":20320256,"omap_allocated":1595,"internal_metadata":557709765},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33481,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24600576,"data_stored":37749396,"data_compressed":4369586,"data_compressed_allocated":6582272,"data_compressed_original":19746816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21450752,"data_stored":34116777,"data_compressed":3943802,"data_compressed_allocated":5832704,"data_compressed_original":18526208,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25399296,"data_stored":41943858,"data_compressed":4947938,"data_compressed_allocated":7106560,"data_compressed_original":23670784,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":64090112,"data_stored":103414036,"data_compressed":12101483,"data_compressed_allocated":17629184,"data_compressed_original":56975360,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":42213376,"data_stored":67109977,"data_compressed":7711798,"data_compressed_allocated":11415552,"data_compressed_original":36327424,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36806656,"data_stored":58721634,"data_compressed":6801610,"data_compressed_allocated":10059776,"data_compressed_original":31993856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":54042624,"data_stored":87198187,"data_compressed":9966163,"data_compressed_allocated":14598144,"data_compressed_original":47775744,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36048896,"data_stored":54527667,"data_compressed":5968998,"data_compressed_allocated":9031680,"data_compressed_original":27529216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T11:06:19.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T11:06:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.428+0000 7fa069600640 1 Processor -- start 2024-04-25T11:06:19.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.428+0000 7fa069600640 1 -- start start 2024-04-25T11:06:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa069600640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa0640c67e0 0x7fa06415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa069600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0640cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa069600640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa06415e8b0 con 0x7fa0640cc700 2024-04-25T11:06:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa069600640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa06415f430 con 0x7fa0640c67e0 2024-04-25T11:06:19.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa069600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa06415eb90 con 0x7fa06415bbe0 2024-04-25T11:06:19.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa063400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa0640cc700 0x7fa0640c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46502/0 (socket says 172.21.15.16:46502) 2024-04-25T11:06:19.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa063400640 1 -- 172.21.15.16:0/726208556 learned_addr learned my addr 172.21.15.16:0/726208556 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:19.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> v2:172.21.15.186:3300/0 conn(0x7fa0640c67e0 0x7fa06415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062000640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0640cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332492769 0 0) 0x7fa06415e8b0 con 0x7fa0640cc700 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0480035c0 con 0x7fa0640cc700 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3108413742 0 0) 0x7fa0480035c0 con 0x7fa0640cc700 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 msgr2=0x7fa0640cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0640cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 >> v2:172.21.15.186:3300/0 conn(0x7fa0640c67e0 msgr2=0x7fa06415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 --2- 172.21.15.16:0/726208556 >> v2:172.21.15.186:3300/0 conn(0x7fa0640c67e0 0x7fa06415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06415ee70 con 0x7fa0640cc700 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> v2:172.21.15.186:3300/0 conn(0x7fa0640c67e0 0x7fa06415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fa05c001a50 con 0x7fa0640cc700 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 >> v1:172.21.15.16:6789/0 conn(0x7fa0640cc700 legacy=0x7fa0640c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa048003a50 0x7fa048003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0480048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa048004de0 0x7fa0480051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa06415f430 con 0x7fa048003a50 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa06415eb90 con 0x7fa048004de0 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa04800bab0 con 0x7fa06415bbe0 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa048003a50 0x7fa048003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062000640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0480048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa063400640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa048004de0 0x7fa0480051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 -- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 msgr2=0x7fa0480048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa06415bbe0 0x7fa0480048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 -- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa048004de0 msgr2=0x7fa0480051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa048004de0 0x7fa0480051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa062a00640 1 -- 172.21.15.16:0/726208556 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0480035c0 con 0x7fa048003a50 2024-04-25T11:06:19.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.432+0000 7fa063400640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa048004de0 0x7fa0480051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T11:06:19.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa062a00640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa048003a50 0x7fa048003ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa054009d60 tx=0x7fa05401ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629f147c69790d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0540b2070 con 0x7fa048003a50 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0540a58d0 con 0x7fa048003a50 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa061600640 1 -- 172.21.15.16:0/726208556 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054009900 con 0x7fa048003a50 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 -- 172.21.15.16:0/726208556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa048003a50 msgr2=0x7fa048003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 --2- 172.21.15.16:0/726208556 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa048003a50 0x7fa048003ec0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa054009d60 tx=0x7fa05401ccf0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa063400640 1 -- 172.21.15.16:0/726208556 reap_dead start 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 -- 172.21.15.16:0/726208556 shutdown_connections 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 -- 172.21.15.16:0/726208556 >> 172.21.15.16:0/726208556 conn(0x7fa0640732e0 msgr2=0x7fa0640736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 -- 172.21.15.16:0/726208556 shutdown_connections 2024-04-25T11:06:19.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.436+0000 7fa069600640 1 -- 172.21.15.16:0/726208556 wait complete. 2024-04-25T11:06:19.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 Processor -- start 2024-04-25T11:06:19.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- start start 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa064146d40 0x7fa064153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa064154370 0x7fa0641f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fa06415e4e0 con 0x7fa0641fa260 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa06415b180 con 0x7fa064154370 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa06415e660 con 0x7fa064146d40 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48136/0 (socket says 172.21.15.16:48136) 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 -- 172.21.15.16:0/214031346 learned_addr learned my addr 172.21.15.16:0/214031346 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa062a00640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa064146d40 0x7fa064153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa062000640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa064154370 0x7fa0641f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 -- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa064146d40 msgr2=0x7fa064153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa064146d40 0x7fa064153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 -- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa064154370 msgr2=0x7fa0641f9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa064154370 0x7fa0641f9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 -- 172.21.15.16:0/214031346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa064154ac0 con 0x7fa0641fa260 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa063400640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0640744a0 tx=0x7fa05c010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c01a070 con 0x7fa0641fa260 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c011040 con 0x7fa0641fa260 2024-04-25T11:06:19.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0640c5cc0 con 0x7fa0641fa260 2024-04-25T11:06:19.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00ed20 con 0x7fa0641fa260 2024-04-25T11:06:19.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.440+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0641fa670 con 0x7fa0641fa260 2024-04-25T11:06:19.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.444+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0640c6ee0 con 0x7fa0641fa260 2024-04-25T11:06:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.444+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa05c01d070 con 0x7fa0641fa260 2024-04-25T11:06:19.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.444+0000 7fa05aa00640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 0x7fa03c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.444+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa05c091f50 con 0x7fa0641fa260 2024-04-25T11:06:19.446 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.444+0000 7fa062a00640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 0x7fa03c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.447 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.448+0000 7fa062a00640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 0x7fa03c071ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa0540046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.448+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa05c05e3b0 con 0x7fa0641fa260 2024-04-25T11:06:19.621 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.620+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa064050750 con 0x7fa0641fa260 2024-04-25T11:06:19.627 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fa05c0626b0 con 0x7fa0641fa260 2024-04-25T11:06:19.628 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa05aa00640 1 -- 172.21.15.16:0/214031346 <== mon.0 v2:172.21.15.16:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa05c05dec0 con 0x7fa0641fa260 2024-04-25T11:06:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 msgr2=0x7fa03c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 0x7fa03c071ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa0540af000 tx=0x7fa0540046d0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 msgr2=0x7fa0640c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0640744a0 tx=0x7fa05c010d00 comp rx=0 tx=0).stop 2024-04-25T11:06:19.630 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 shutdown_connections 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fa03c06f5a0 0x7fa03c071ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0641fa260 0x7fa0640c43a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa064154370 0x7fa0641f9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 --2- 172.21.15.16:0/214031346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa064146d40 0x7fa064153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 >> 172.21.15.16:0/214031346 conn(0x7fa0640732e0 msgr2=0x7fa0640cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 shutdown_connections 2024-04-25T11:06:19.631 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.628+0000 7fa069600640 1 -- 172.21.15.16:0/214031346 wait complete. 2024-04-25T11:06:19.651 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T11:06:19.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:06:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 Processor -- start 2024-04-25T11:06:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 -- start start 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff610154060 0x7ff6100c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff61015a7c0 0x7ff61015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6100c9510 con 0x7ff6100c3030 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7ff61015e110 con 0x7ff610154060 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff61015abd0 con 0x7ff61015a7c0 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff610154060 0x7ff6100c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff610154060 0x7ff6100c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48140/0 (socket says 172.21.15.16:48140) 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 -- 172.21.15.16:0/4121953167 learned_addr learned my addr 172.21.15.16:0/4121953167 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff616400640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff61015a7c0 0x7ff61015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 -- 172.21.15.16:0/4121953167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff61015a7c0 msgr2=0x7ff61015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff61015a7c0 0x7ff61015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 -- 172.21.15.16:0/4121953167 >> v1:172.21.15.186:6789/0 conn(0x7ff6100c3030 legacy=0x7ff6100caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.806 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.804+0000 7ff615a00640 1 -- 172.21.15.16:0/4121953167 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6100c97f0 con 0x7ff610154060 2024-04-25T11:06:19.808 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff615a00640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff610154060 0x7ff6100c36f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff60400bc70 tx=0x7ff604021520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d47a5fa00a84b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff60fe00640 1 -- 172.21.15.16:0/4121953167 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040b8070 con 0x7ff610154060 2024-04-25T11:06:19.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff60fe00640 1 -- 172.21.15.16:0/4121953167 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff6040b3640 con 0x7ff610154060 2024-04-25T11:06:19.809 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff60fe00640 1 -- 172.21.15.16:0/4121953167 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040b3a70 con 0x7ff610154060 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 -- 172.21.15.16:0/4121953167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff610154060 msgr2=0x7ff6100c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff610154060 0x7ff6100c36f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff60400bc70 tx=0x7ff604021520 comp rx=0 tx=0).stop 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 -- 172.21.15.16:0/4121953167 shutdown_connections 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff61015a7c0 0x7ff61015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 --2- 172.21.15.16:0/4121953167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff610154060 0x7ff6100c36f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 -- 172.21.15.16:0/4121953167 >> 172.21.15.16:0/4121953167 conn(0x7ff610071ef0 msgr2=0x7ff610072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 -- 172.21.15.16:0/4121953167 shutdown_connections 2024-04-25T11:06:19.810 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.808+0000 7ff616e00640 1 -- 172.21.15.16:0/4121953167 wait complete. 2024-04-25T11:06:19.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 Processor -- start 2024-04-25T11:06:19.812 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 -- start start 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff610154060 0x7ff610146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff61015a7c0 0x7ff6100c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7ff61015a2a0 con 0x7ff6100c3030 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff610159fc0 con 0x7ff61015a7c0 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff6100c9ad0 con 0x7ff610154060 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff615a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.815 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff615a00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48152/0 (socket says 172.21.15.16:48152) 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff615a00640 1 -- 172.21.15.16:0/3293001343 learned_addr learned my addr 172.21.15.16:0/3293001343 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff616400640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff61015a7c0 0x7ff6100c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.812+0000 7ff615000640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff610154060 0x7ff610146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 -- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff610154060 msgr2=0x7ff610146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff610154060 0x7ff610146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 -- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff61015a7c0 msgr2=0x7ff6100c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff61015a7c0 0x7ff6100c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 -- 172.21.15.16:0/3293001343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff610147460 con 0x7ff6100c3030 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff615a00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff60401f150 tx=0x7ff60401e2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040c1070 con 0x7ff6100c3030 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff6040b1750 con 0x7ff6100c3030 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6040b8070 con 0x7ff6100c3030 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61015d300 con 0x7ff6100c3030 2024-04-25T11:06:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61015d5a0 con 0x7ff6100c3030 2024-04-25T11:06:19.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610076d30 con 0x7ff6100c3030 2024-04-25T11:06:19.817 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.816+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6040b1c00 con 0x7ff6100c3030 2024-04-25T11:06:19.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.820+0000 7ff60d600640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 0x7ff5ec071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:19.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.820+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff60412d4c0 con 0x7ff6100c3030 2024-04-25T11:06:19.819 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.820+0000 7ff615000640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 0x7ff5ec071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.820+0000 7ff615000640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 0x7ff5ec071ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6101e3970 tx=0x7ff5fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:19.823 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:19.824+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff60401b080 con 0x7ff6100c3030 2024-04-25T11:06:20.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.024+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6101eb4c0 con 0x7ff6100c3030 2024-04-25T11:06:20.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.024+0000 7ff60d600640 1 -- 172.21.15.16:0/3293001343 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7ff6040f9ed0 con 0x7ff6100c3030 2024-04-25T11:06:20.026 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:06:20.026 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T11:06:20.026 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 msgr2=0x7ff5ec071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 0x7ff5ec071ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff6101e3970 tx=0x7ff5fc009040 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 msgr2=0x7ff6101f9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff60401f150 tx=0x7ff60401e2c0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 shutdown_connections 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7ff5ec06f5a0 0x7ff5ec071ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff61015a7c0 0x7ff6100c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff610154060 0x7ff610146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 --2- 172.21.15.16:0/3293001343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff6100c3030 0x7ff6101f9020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 >> 172.21.15.16:0/3293001343 conn(0x7ff610071ef0 msgr2=0x7ff6100b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 shutdown_connections 2024-04-25T11:06:20.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.028+0000 7ff616e00640 1 -- 172.21.15.16:0/3293001343 wait complete. 2024-04-25T11:06:20.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T11:06:20.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 Processor -- start 2024-04-25T11:06:20.200 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 -- start start 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86940c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869415b3d0 con 0x7f86940c7040 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869415b6b0 con 0x7f86940c4800 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8698e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f869415b990 con 0x7f86940b95d0 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f868be00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f86940c7040 0x7f86940b8ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46512/0 (socket says 172.21.15.16:46512) 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f868be00640 1 -- 172.21.15.16:0/4224981767 learned_addr learned my addr 172.21.15.16:0/4224981767 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:20.202 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8692800640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86940c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410762156 0 0) 0x7f869415b3d0 con 0x7f86940c7040 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.200+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86780035c0 con 0x7f86940c7040 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1182419280 0 0) 0x7f86780035c0 con 0x7f86940c7040 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 msgr2=0x7f86940c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86940c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 >> v1:172.21.15.186:6789/0 conn(0x7f86940c4800 legacy=0x7f869415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869415bc70 con 0x7f86940c7040 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7f867c0016d0 con 0x7f86940c7040 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 >> v1:172.21.15.16:6789/0 conn(0x7f86940c7040 legacy=0x7f86940b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8678003a80 0x7f8678003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86780048a0 0x7f8678004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86780051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f869415b990 con 0x7f86780048a0 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f867800bb10 con 0x7f8678003a80 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f867800bd10 con 0x7f86940b95d0 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86780048a0 0x7f8678004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8692800640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86780051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691e00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8678003a80 0x7f8678003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 -- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 msgr2=0x7f86780051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86780051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 -- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8678003a80 msgr2=0x7f8678003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8678003a80 0x7f8678003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 -- 172.21.15.16:0/4224981767 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86780035c0 con 0x7f86780048a0 2024-04-25T11:06:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8692800640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86940b95d0 0x7f86780051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f8691e00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8678003a80 0x7f8678003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:20.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.204+0000 7f868be00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86780048a0 0x7f8678004cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86941410e0 tx=0x7f867c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732cc50933c68fa2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c007d80 con 0x7f86780048a0 2024-04-25T11:06:20.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f867c0a9020 con 0x7f86780048a0 2024-04-25T11:06:20.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8691400640 1 -- 172.21.15.16:0/4224981767 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a5c00 con 0x7f86780048a0 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- 172.21.15.16:0/4224981767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86780048a0 msgr2=0x7f8678004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 --2- 172.21.15.16:0/4224981767 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86780048a0 0x7f8678004cb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f86941410e0 tx=0x7f867c01cca0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8692800640 1 -- 172.21.15.16:0/4224981767 reap_dead start 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- 172.21.15.16:0/4224981767 shutdown_connections 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- 172.21.15.16:0/4224981767 >> 172.21.15.16:0/4224981767 conn(0x7f86940ca4b0 msgr2=0x7f86940ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- 172.21.15.16:0/4224981767 shutdown_connections 2024-04-25T11:06:20.208 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- 172.21.15.16:0/4224981767 wait complete. 2024-04-25T11:06:20.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 Processor -- start 2024-04-25T11:06:20.210 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.208+0000 7f8698e00640 1 -- start start 2024-04-25T11:06:20.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86941592c0 0x7f86941596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86941ea0b0 0x7f86941ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.213 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f86940c9180 con 0x7f86941e5ca0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f869415f300 con 0x7f86941592c0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f86940c7450 con 0x7f86941ea0b0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48160/0 (socket says 172.21.15.16:48160) 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 -- 172.21.15.16:0/2266367992 learned_addr learned my addr 172.21.15.16:0/2266367992 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f868be00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86941592c0 0x7f86941596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8692800640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86941ea0b0 0x7f86941ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 -- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86941ea0b0 msgr2=0x7f86941ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86941ea0b0 0x7f86941ea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 -- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86941592c0 msgr2=0x7f86941596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86941592c0 0x7f86941596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 -- 172.21.15.16:0/2266367992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86941e59c0 con 0x7f86941e5ca0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8691e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8684010f50 tx=0x7f868400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.214 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684018020 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8684005070 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86941f9a70 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684005460 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86941fa030 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.212+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8694050750 con 0x7f86941e5ca0 2024-04-25T11:06:20.215 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.216+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f868401b020 con 0x7f86941e5ca0 2024-04-25T11:06:20.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.216+0000 7f868a000640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 0x7f866c071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.216+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f8684092e00 con 0x7f86941e5ca0 2024-04-25T11:06:20.216 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.216+0000 7f868be00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 0x7f866c071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.217 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.216+0000 7f868be00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 0x7f866c071ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f867c0aa000 tx=0x7f869415b880 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.220 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.220+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8684022020 con 0x7f86941e5ca0 2024-04-25T11:06:20.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86940cd080 con 0x7f86941e5ca0 2024-04-25T11:06:20.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f868a000640 1 -- 172.21.15.16:0/2266367992 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6879 (secure 0 0 0) 0x7f868405f8a0 con 0x7f86941e5ca0 2024-04-25T11:06:20.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:06:20.420 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/3078608548","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3078608548},{"type":"v1","addr":"172.21.15.16:6834","nonce":3078608548}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4262,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6837/2698231577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6835","nonce":2698231577},{"type":"v1","addr":"172.21.15.16:6837","nonce":2698231577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/3676823029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6835","nonce":3676823029},{"type":"v1","addr":"172.21.15.186:6837","nonce":3676823029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:38:58.741400+0000","modified":"2024-04-25T10:39:25.793300+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4306,"mds_1":4294,"mds_2":4268},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4268":{"gid":4268,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.186:6836/4138025047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":4138025047},{"type":"v1","addr":"172.21.15.186:6836","nonce":4138025047}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"c","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.16:6836/3989858208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":3989858208},{"type":"v1","addr":"172.21.15.16:6836","nonce":3989858208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4306":{"gid":4306,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/3608237615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":3608237615},{"type":"v1","addr":"172.21.15.186:6839","nonce":3608237615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4306,"qdb_cluster":[4268,4294,4306]},"id":1}]} 2024-04-25T11:06:20.421 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 13 2024-04-25T11:06:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 msgr2=0x7f866c071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.422 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 0x7f866c071ae0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f867c0aa000 tx=0x7f869415b880 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 msgr2=0x7f86941f6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8684010f50 tx=0x7f868400e530 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 shutdown_connections 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f866c06f5d0 0x7f866c071ae0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f86941ea0b0 0x7f86941ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f86941592c0 0x7f86941596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 --2- 172.21.15.16:0/2266367992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86941e5ca0 0x7f86941f6d10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 >> 172.21.15.16:0/2266367992 conn(0x7f86940ca4b0 msgr2=0x7f869415bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 shutdown_connections 2024-04-25T11:06:20.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.420+0000 7f8698e00640 1 -- 172.21.15.16:0/2266367992 wait complete. 2024-04-25T11:06:20.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T11:06:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.592+0000 7f607c600640 1 Processor -- start 2024-04-25T11:06:20.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.592+0000 7f607c600640 1 -- start start 2024-04-25T11:06:20.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607c600640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6074153fc0 0x7f60740c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607c600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60740c4df0 0x7f60741647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607c600640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60740ca9e0 con 0x7f60740c9190 2024-04-25T11:06:20.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607c600640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7f60740c7c40 con 0x7f6074153fc0 2024-04-25T11:06:20.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607c600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f60740c7e90 con 0x7f60740c4df0 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6074153fc0 0x7f60740c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6074153fc0 0x7f60740c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48172/0 (socket says 172.21.15.16:48172) 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 -- 172.21.15.16:0/2800954708 learned_addr learned my addr 172.21.15.16:0/2800954708 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f607a600640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60740c4df0 0x7f60741647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 -- 172.21.15.16:0/2800954708 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60740c4df0 msgr2=0x7f60741647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60740c4df0 0x7f60741647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 -- 172.21.15.16:0/2800954708 >> v1:172.21.15.186:6789/0 conn(0x7f60740c9190 legacy=0x7f60740c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.596+0000 7f6079c00640 1 -- 172.21.15.16:0/2800954708 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60740c8170 con 0x7f6074153fc0 2024-04-25T11:06:20.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f6079c00640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6074153fc0 0x7f60740c8c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60740c7dc0 tx=0x7f606801e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7dfc743e9e6d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f6073e00640 1 -- 172.21.15.16:0/2800954708 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680ab640 con 0x7f6074153fc0 2024-04-25T11:06:20.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f6073e00640 1 -- 172.21.15.16:0/2800954708 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f60680ab7e0 con 0x7f6074153fc0 2024-04-25T11:06:20.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f6073e00640 1 -- 172.21.15.16:0/2800954708 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680abc10 con 0x7f6074153fc0 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 -- 172.21.15.16:0/2800954708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6074153fc0 msgr2=0x7f60740c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6074153fc0 0x7f60740c8c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f60740c7dc0 tx=0x7f606801e870 comp rx=0 tx=0).stop 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 -- 172.21.15.16:0/2800954708 shutdown_connections 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f60740c4df0 0x7f60741647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 --2- 172.21.15.16:0/2800954708 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6074153fc0 0x7f60740c8c50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 -- 172.21.15.16:0/2800954708 >> 172.21.15.16:0/2800954708 conn(0x7f60740cdc80 msgr2=0x7f60740c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 -- 172.21.15.16:0/2800954708 shutdown_connections 2024-04-25T11:06:20.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.600+0000 7f607c600640 1 -- 172.21.15.16:0/2800954708 wait complete. 2024-04-25T11:06:20.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 Processor -- start 2024-04-25T11:06:20.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 -- start start 2024-04-25T11:06:20.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 0x7f60741f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 0x7f607414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f6074154550 con 0x7f60740c9190 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f60741543d0 con 0x7f60740c4df0 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f60740ca5a0 con 0x7f6074153fc0 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48180/0 (socket says 172.21.15.16:48180) 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 -- 172.21.15.16:0/2272903741 learned_addr learned my addr 172.21.15.16:0/2272903741 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607a600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 0x7f607414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079c00640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 0x7f60741f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 -- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 msgr2=0x7f607414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 0x7f607414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 -- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 msgr2=0x7f60741f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 0x7f60741f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 -- 172.21.15.16:0/2272903741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60741607b0 con 0x7f60740c9190 2024-04-25T11:06:20.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079c00640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 0x7f60741f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:20.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607a600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 0x7f607414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:20.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6079200640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f606000c4c0 tx=0x7f606000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060016020 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f60600052d0 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741617f0 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.604+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060007280 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607415dfe0 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6074160520 con 0x7f60740c9190 2024-04-25T11:06:20.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f60600074e0 con 0x7f60740c9190 2024-04-25T11:06:20.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f6071600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 0x7f6050071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f606008f190 con 0x7f60740c9190 2024-04-25T11:06:20.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.608+0000 7f6079c00640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 0x7f6050071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.612+0000 7f6079c00640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 0x7f6050071ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f60740c3d20 tx=0x7f60680a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.613 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.612+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6060020020 con 0x7f60740c9190 2024-04-25T11:06:20.782 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.780+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6074158580 con 0x7f60740c9190 2024-04-25T11:06:20.783 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f6071600640 1 -- 172.21.15.16:0/2272903741 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18891 (secure 0 0 0) 0x7f6060005480 con 0x7f60740c9190 2024-04-25T11:06:20.783 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-25T11:06:20.784 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":28,"fsid":"0bf3f6ca-8da3-483e-865e-01c1c2057abb","created":"2024-04-25T10:38:32.926177+0000","modified":"2024-04-25T10:39:38.897256+0000","last_up_change":"2024-04-25T10:38:44.225694+0000","last_in_change":"2024-04-25T10:38:35.539456+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:38:45.700761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:38:56.312069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:38:57.697392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:39:01.362964+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b1ae3adf-694c-4bbc-86d3-dd6282c91ef0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6801","nonce":641177332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6803","nonce":641177332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6807","nonce":641177332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":641177332},{"type":"v1","addr":"172.21.15.16:6805","nonce":641177332}]},"public_addr":"172.21.15.16:6801/641177332","cluster_addr":"172.21.15.16:6803/641177332","heartbeat_back_addr":"172.21.15.16:6807/641177332","heartbeat_front_addr":"172.21.15.16:6805/641177332","state":["exists","up"]},{"osd":1,"uuid":"89a430a8-b787-47ed-9b0c-ad3528357eca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6817","nonce":2432671157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6819","nonce":2432671157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6823","nonce":2432671157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":2432671157},{"type":"v1","addr":"172.21.15.16:6821","nonce":2432671157}]},"public_addr":"172.21.15.16:6817/2432671157","cluster_addr":"172.21.15.16:6819/2432671157","heartbeat_back_addr":"172.21.15.16:6823/2432671157","heartbeat_front_addr":"172.21.15.16:6821/2432671157","state":["exists","up"]},{"osd":2,"uuid":"5d56f0bb-ded6-4168-ac5a-032df75b7e1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6809","nonce":659353344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6811","nonce":659353344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6815","nonce":659353344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":659353344},{"type":"v1","addr":"172.21.15.16:6813","nonce":659353344}]},"public_addr":"172.21.15.16:6809/659353344","cluster_addr":"172.21.15.16:6811/659353344","heartbeat_back_addr":"172.21.15.16:6815/659353344","heartbeat_front_addr":"172.21.15.16:6813/659353344","state":["exists","up"]},{"osd":3,"uuid":"c3ec0e48-5a10-45d0-9c32-dc0f523ce71b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6825","nonce":2989148633}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6827","nonce":2989148633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6831","nonce":2989148633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2989148633},{"type":"v1","addr":"172.21.15.16:6829","nonce":2989148633}]},"public_addr":"172.21.15.16:6825/2989148633","cluster_addr":"172.21.15.16:6827/2989148633","heartbeat_back_addr":"172.21.15.16:6831/2989148633","heartbeat_front_addr":"172.21.15.16:6829/2989148633","state":["exists","up"]},{"osd":4,"uuid":"aab30584-3e43-46b7-99f0-08a0e21d509f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6801","nonce":1251728210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6803","nonce":1251728210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6807","nonce":1251728210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":1251728210},{"type":"v1","addr":"172.21.15.186:6805","nonce":1251728210}]},"public_addr":"172.21.15.186:6801/1251728210","cluster_addr":"172.21.15.186:6803/1251728210","heartbeat_back_addr":"172.21.15.186:6807/1251728210","heartbeat_front_addr":"172.21.15.186:6805/1251728210","state":["exists","up"]},{"osd":5,"uuid":"a770ed96-5340-4c4e-97bc-f72012ab06af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6819","nonce":1601716683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6823","nonce":1601716683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6829","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6831","nonce":1601716683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6825","nonce":1601716683},{"type":"v1","addr":"172.21.15.186:6827","nonce":1601716683}]},"public_addr":"172.21.15.186:6819/1601716683","cluster_addr":"172.21.15.186:6823/1601716683","heartbeat_back_addr":"172.21.15.186:6831/1601716683","heartbeat_front_addr":"172.21.15.186:6827/1601716683","state":["exists","up"]},{"osd":6,"uuid":"d9de2d31-45f2-46af-aba8-be8a200431bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6809","nonce":1602964832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6811","nonce":1602964832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6815","nonce":1602964832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":1602964832},{"type":"v1","addr":"172.21.15.186:6813","nonce":1602964832}]},"public_addr":"172.21.15.186:6809/1602964832","cluster_addr":"172.21.15.186:6811/1602964832","heartbeat_back_addr":"172.21.15.186:6815/1602964832","heartbeat_front_addr":"172.21.15.186:6813/1602964832","state":["exists","up"]},{"osd":7,"uuid":"a5e194aa-e4d2-4888-8c5b-0f9696919c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6818","nonce":3819886941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6822","nonce":3819886941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6830","nonce":3819886941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3819886941},{"type":"v1","addr":"172.21.15.186:6826","nonce":3819886941}]},"public_addr":"172.21.15.186:6818/3819886941","cluster_addr":"172.21.15.186:6822/3819886941","heartbeat_back_addr":"172.21.15.186:6830/3819886941","heartbeat_front_addr":"172.21.15.186:6826/3819886941","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.142331+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.219757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.203574+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.410289+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.052458+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.180102+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.115598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:38:41.104223+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.f","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 msgr2=0x7f6050071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 0x7f6050071ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f60740c3d20 tx=0x7f60680a9000 comp rx=0 tx=0).stop 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 msgr2=0x7f60741622d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f606000c4c0 tx=0x7f606000c980 comp rx=0 tx=0).stop 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 shutdown_connections 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f605006f5a0 0x7f6050071ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.786 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6074153fc0 0x7f607414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60740c9190 0x7f60741622d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 --2- 172.21.15.16:0/2272903741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60740c4df0 0x7f60741f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 >> 172.21.15.16:0/2272903741 conn(0x7f60740cdc80 msgr2=0x7f607415b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 shutdown_connections 2024-04-25T11:06:20.787 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.784+0000 7f607c600640 1 -- 172.21.15.16:0/2272903741 wait complete. 2024-04-25T11:06:20.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T11:06:20.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.960+0000 7f9eb2800640 1 Processor -- start 2024-04-25T11:06:20.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.960+0000 7f9eb2800640 1 -- start start 2024-04-25T11:06:20.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eb2800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9eac153fc0 0x7f9eac0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eb2800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eac0ca9e0 con 0x7f9eac0c4df0 2024-04-25T11:06:20.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eb2800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eac0c7e90 con 0x7f9eac0c9190 2024-04-25T11:06:20.963 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eb2800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac0c7c40 con 0x7f9eac153fc0 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eabe00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9eac0c4df0 0x7f9eac1647c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46528/0 (socket says 172.21.15.16:46528) 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eabe00640 1 -- 172.21.15.16:0/3327029551 learned_addr learned my addr 172.21.15.16:0/3327029551 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eab400640 1 --2- 172.21.15.16:0/3327029551 >> v2:172.21.15.186:3300/0 conn(0x7f9eac153fc0 0x7f9eac0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304498159 0 0) 0x7f9eac0ca9e0 con 0x7f9eac0c4df0 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e900035c0 con 0x7f9eac0c4df0 2024-04-25T11:06:20.964 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eab400640 1 -- 172.21.15.16:0/3327029551 >> v1:172.21.15.186:6789/0 conn(0x7f9eac0c9190 legacy=0x7f9eac0c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 25879786 0 0) 0x7f9e900035c0 con 0x7f9eac0c4df0 2024-04-25T11:06:20.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eab400640 1 -- 172.21.15.16:0/3327029551 >> v1:172.21.15.16:6789/0 conn(0x7f9eac0c4df0 legacy=0x7f9eac1647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.965 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.964+0000 7f9eab400640 1 -- 172.21.15.16:0/3327029551 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac0c8170 con 0x7f9eac153fc0 2024-04-25T11:06:20.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eab400640 1 --2- 172.21.15.16:0/3327029551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac153fc0 0x7f9eac0c8c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009900 tx=0x7f9e9c01c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3fe569deddb4d9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0b0070 con 0x7f9eac153fc0 2024-04-25T11:06:20.967 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e9c0ab400 con 0x7f9eac153fc0 2024-04-25T11:06:20.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eaaa00640 1 -- 172.21.15.16:0/3327029551 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4001a50 con 0x7f9eac153fc0 2024-04-25T11:06:20.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 -- 172.21.15.16:0/3327029551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac153fc0 msgr2=0x7f9eac0c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3327029551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac153fc0 0x7f9eac0c8c50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c009900 tx=0x7f9e9c01c4c0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 -- 172.21.15.16:0/3327029551 shutdown_connections 2024-04-25T11:06:20.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3327029551 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac153fc0 0x7f9eac0c8c50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 -- 172.21.15.16:0/3327029551 >> 172.21.15.16:0/3327029551 conn(0x7f9eac0cdc80 msgr2=0x7f9eac0c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:20.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 -- 172.21.15.16:0/3327029551 shutdown_connections 2024-04-25T11:06:20.969 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.968+0000 7f9eb2800640 1 -- 172.21.15.16:0/3327029551 wait complete. 2024-04-25T11:06:20.970 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 Processor -- start 2024-04-25T11:06:20.971 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- start start 2024-04-25T11:06:20.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 0x7f9eac151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9eac0c9190 0x7f9eac148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.974 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac154550 con 0x7f9eac153fc0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac1543d0 con 0x7f9eac0c4df0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac0ca5a0 con 0x7f9eac0c9190 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48184/0 (socket says 172.21.15.16:48184) 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 -- 172.21.15.16:0/3894097478 learned_addr learned my addr 172.21.15.16:0/3894097478 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eab400640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 0x7f9eac151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9ea3e00640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9eac0c9190 0x7f9eac148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 -- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9eac0c9190 msgr2=0x7f9eac148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9eac0c9190 0x7f9eac148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 -- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 msgr2=0x7f9eac151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 0x7f9eac151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 -- 172.21.15.16:0/3894097478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac1505d0 con 0x7f9eac153fc0 2024-04-25T11:06:20.975 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eab400640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 0x7f9eac151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eabe00640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400cc90 tx=0x7f9ea400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4017070 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9ea4012400 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4012850 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac151870 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.972+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac150850 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.976+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac050750 con 0x7f9eac153fc0 2024-04-25T11:06:20.976 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.976+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9ea401a070 con 0x7f9eac153fc0 2024-04-25T11:06:20.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.976+0000 7f9ea3400640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 0x7f9e84071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:20.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.976+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9ea408f760 con 0x7f9eac153fc0 2024-04-25T11:06:20.978 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.976+0000 7f9eab400640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 0x7f9e84071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:20.979 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.980+0000 7f9eab400640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 0x7f9e84071ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0ad000 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:20.982 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:20.980+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9eac1505d0 con 0x7f9eac153fc0 2024-04-25T11:06:21.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.180+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9eac1494e0 con 0x7f9eac153fc0 2024-04-25T11:06:21.183 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.184+0000 7f9ea3400640 1 -- 172.21.15.16:0/3894097478 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7f9ea405c170 con 0x7f9eac153fc0 2024-04-25T11:06:21.183 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T11:06:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.184+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 msgr2=0x7f9e84071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.184+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 0x7f9e84071ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0ad000 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2024-04-25T11:06:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.184+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 msgr2=0x7f9eac155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.188 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.184+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400cc90 tx=0x7f9ea400a430 comp rx=0 tx=0).stop 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 shutdown_connections 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f9e8406f5a0 0x7f9e84071ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9eac153fc0 0x7f9eac155390 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9eac0c9190 0x7f9eac148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 --2- 172.21.15.16:0/3894097478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9eac0c4df0 0x7f9eac151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 >> 172.21.15.16:0/3894097478 conn(0x7f9eac0cdc80 msgr2=0x7f9eac158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 shutdown_connections 2024-04-25T11:06:21.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.188+0000 7f9eb2800640 1 -- 172.21.15.16:0/3894097478 wait complete. 2024-04-25T11:06:21.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T11:06:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 Processor -- start 2024-04-25T11:06:21.368 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 -- start start 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea980c8c50 0x7fea9815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea98163890 0x7fea98165cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea980cad70 con 0x7fea9815bce0 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 -- 0x7fea980c2510 con 0x7fea98163890 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9f200640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fea980cb560 con 0x7fea980c8c50 2024-04-25T11:06:21.370 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea97400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea9815bce0 0x7fea980c78e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46538/0 (socket says 172.21.15.16:46538) 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea97400640 1 -- 172.21.15.16:0/4187007492 learned_addr learned my addr 172.21.15.16:0/4187007492 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea9d200640 1 --2- 172.21.15.16:0/4187007492 >> v2:172.21.15.16:3300/0 conn(0x7fea98163890 0x7fea98165cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.368+0000 7fea97e00640 1 --2- 172.21.15.16:0/4187007492 >> v2:172.21.15.186:3300/0 conn(0x7fea980c8c50 0x7fea9815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea9d200640 1 -- 172.21.15.16:0/4187007492 >> v2:172.21.15.186:3300/0 conn(0x7fea980c8c50 msgr2=0x7fea9815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea9d200640 1 --2- 172.21.15.16:0/4187007492 >> v2:172.21.15.186:3300/0 conn(0x7fea980c8c50 0x7fea9815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea9d200640 1 -- 172.21.15.16:0/4187007492 >> v1:172.21.15.16:6789/0 conn(0x7fea9815bce0 legacy=0x7fea980c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.371 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea9d200640 1 -- 172.21.15.16:0/4187007492 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9815e530 con 0x7fea98163890 2024-04-25T11:06:21.373 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2024-04-25T11:06:21.373 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea9d200640 1 --2- 172.21.15.16:0/4187007492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea98163890 0x7fea98165cb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea98073f20 tx=0x7fea9001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59ab09387153c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea96a00640 1 -- 172.21.15.16:0/4187007492 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea900b2070 con 0x7fea98163890 2024-04-25T11:06:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea96a00640 1 -- 172.21.15.16:0/4187007492 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea900a5900 con 0x7fea98163890 2024-04-25T11:06:21.374 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.372+0000 7fea96a00640 1 -- 172.21.15.16:0/4187007492 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea900a5d30 con 0x7fea98163890 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- 172.21.15.16:0/4187007492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea98163890 msgr2=0x7fea98165cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 --2- 172.21.15.16:0/4187007492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea98163890 0x7fea98165cb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fea98073f20 tx=0x7fea9001ca30 comp rx=0 tx=0).stop 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- 172.21.15.16:0/4187007492 shutdown_connections 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 --2- 172.21.15.16:0/4187007492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea98163890 0x7fea98165cb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 --2- 172.21.15.16:0/4187007492 >> v2:172.21.15.186:3300/0 conn(0x7fea980c8c50 0x7fea9815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- 172.21.15.16:0/4187007492 >> 172.21.15.16:0/4187007492 conn(0x7fea9806dd80 msgr2=0x7fea98072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- 172.21.15.16:0/4187007492 shutdown_connections 2024-04-25T11:06:21.375 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- 172.21.15.16:0/4187007492 wait complete. 2024-04-25T11:06:21.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 Processor -- start 2024-04-25T11:06:21.377 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.376+0000 7fea9f200640 1 -- start start 2024-04-25T11:06:21.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea9815bce0 0x7fea98150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea98163890 0x7fea98150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fea980c2230 con 0x7fea980c8c50 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fea980c1f90 con 0x7fea98163890 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fea9815b280 con 0x7fea9815bce0 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48224/0 (socket says 172.21.15.16:48224) 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 -- 172.21.15.16:0/1485195776 learned_addr learned my addr 172.21.15.16:0/1485195776 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97400640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea9815bce0 0x7fea98150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9d200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea98163890 0x7fea98150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 -- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea9815bce0 msgr2=0x7fea98150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea9815bce0 0x7fea98150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 -- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea98163890 msgr2=0x7fea98150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea98163890 0x7fea98150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 -- 172.21.15.16:0/1485195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea98163ca0 con 0x7fea980c8c50 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea97e00640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fea8800e9b0 tx=0x7fea8800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea88017070 con 0x7fea980c8c50 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea8800c9a0 con 0x7fea980c8c50 2024-04-25T11:06:21.381 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8800cd90 con 0x7fea980c8c50 2024-04-25T11:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea98165ed0 con 0x7fea980c8c50 2024-04-25T11:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea98164220 con 0x7fea980c8c50 2024-04-25T11:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.380+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea98050750 con 0x7fea980c8c50 2024-04-25T11:06:21.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.384+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fea8801a070 con 0x7fea980c8c50 2024-04-25T11:06:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.384+0000 7fea8fe00640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 0x7fea70071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.384+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6993+0+0 (secure 0 0 0) 0x7fea8808fc20 con 0x7fea980c8c50 2024-04-25T11:06:21.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.384+0000 7fea97400640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 0x7fea70071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:21.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.384+0000 7fea97400640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 0x7fea70071ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea98158b70 tx=0x7fea84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:21.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.388+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea8805bed0 con 0x7fea980c8c50 2024-04-25T11:06:21.558 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-04-25T11:06:21.559 INFO:tasks.ceph.mds.f.smithi186.stdout:starting mds.f at 2024-04-25T11:06:21.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:21.592+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea980cd870 con 0x7fea980c8c50 2024-04-25T11:06:22.186 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.184+0000 7fea8fe00640 1 -- 172.21.15.16:0/1485195776 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fea880601d0 con 0x7fea980c8c50 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 msgr2=0x7fea70071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 0x7fea70071ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea98158b70 tx=0x7fea84009040 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 msgr2=0x7fea980c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fea8800e9b0 tx=0x7fea8800ee70 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 shutdown_connections 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fea7006f5d0 0x7fea70071ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea98163890 0x7fea98150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea9815bce0 0x7fea98150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 --2- 172.21.15.16:0/1485195776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea980c8c50 0x7fea980c56d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.189 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 >> 172.21.15.16:0/1485195776 conn(0x7fea9806dd80 msgr2=0x7fea9815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:22.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 shutdown_connections 2024-04-25T11:06:22.190 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.188+0000 7fea9f200640 1 -- 172.21.15.16:0/1485195776 wait complete. 2024-04-25T11:06:22.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T11:06:22.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 Processor -- start 2024-04-25T11:06:22.376 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 -- start start 2024-04-25T11:06:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f569815ae80 0x7f56980c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 0x7f5698165800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.378 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56980ce000 con 0x7f569815eff0 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f569815f400 con 0x7f569815ae80 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569fa00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f569815b290 con 0x7f56980c6e30 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569d000640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f569815eff0 0x7f56980cd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46550/0 (socket says 172.21.15.16:46550) 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.376+0000 7f569d000640 1 -- 172.21.15.16:0/845830162 learned_addr learned my addr 172.21.15.16:0/845830162 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f569da00640 1 --2- 172.21.15.16:0/845830162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 0x7f5698165800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.379 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f5697e00640 1 --2- 172.21.15.16:0/845830162 >> v2:172.21.15.186:3300/0 conn(0x7f569815ae80 0x7f56980c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644001998 0 0) 0x7f56980ce000 con 0x7f569815eff0 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56800035c0 con 0x7f569815eff0 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2497837668 0 0) 0x7f56800035c0 con 0x7f569815eff0 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f569da00640 1 -- 172.21.15.16:0/845830162 >> v2:172.21.15.186:3300/0 conn(0x7f569815ae80 msgr2=0x7f56980c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f569da00640 1 --2- 172.21.15.16:0/845830162 >> v2:172.21.15.186:3300/0 conn(0x7f569815ae80 0x7f56980c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f569da00640 1 -- 172.21.15.16:0/845830162 >> v1:172.21.15.16:6789/0 conn(0x7f569815eff0 legacy=0x7f56980cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.380 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.380+0000 7f569da00640 1 -- 172.21.15.16:0/845830162 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56980b9340 con 0x7f56980c6e30 2024-04-25T11:06:22.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569da00640 1 --2- 172.21.15.16:0/845830162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 0x7f5698165800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5690009ee0 tx=0x7f569001f180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef326400edc132c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56900b4070 con 0x7f56980c6e30 2024-04-25T11:06:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f56900af400 con 0x7f56980c6e30 2024-04-25T11:06:22.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f5697400640 1 -- 172.21.15.16:0/845830162 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c0016d0 con 0x7f56980c6e30 2024-04-25T11:06:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- 172.21.15.16:0/845830162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 msgr2=0x7f5698165800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 --2- 172.21.15.16:0/845830162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 0x7f5698165800 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5690009ee0 tx=0x7f569001f180 comp rx=0 tx=0).stop 2024-04-25T11:06:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- 172.21.15.16:0/845830162 shutdown_connections 2024-04-25T11:06:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 --2- 172.21.15.16:0/845830162 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f56980c6e30 0x7f5698165800 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.384 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 --2- 172.21.15.16:0/845830162 >> v2:172.21.15.186:3300/0 conn(0x7f569815ae80 0x7f56980c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- 172.21.15.16:0/845830162 >> 172.21.15.16:0/845830162 conn(0x7f569806cc70 msgr2=0x7f56980cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:22.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- 172.21.15.16:0/845830162 shutdown_connections 2024-04-25T11:06:22.385 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- 172.21.15.16:0/845830162 wait complete. 2024-04-25T11:06:22.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 Processor -- start 2024-04-25T11:06:22.386 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.384+0000 7f569fa00640 1 -- start start 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56980c6e30 0x7f569813dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f569815ae80 0x7f56980c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7f569815e510 con 0x7f569815eff0 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f56980b9900 con 0x7f56980c6e30 2024-04-25T11:06:22.388 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f569815e7f0 con 0x7f569815ae80 2024-04-25T11:06:22.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48228/0 (socket says 172.21.15.16:48228) 2024-04-25T11:06:22.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 -- 172.21.15.16:0/3273267438 learned_addr learned my addr 172.21.15.16:0/3273267438 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:22.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f5697e00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f569815ae80 0x7f56980c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.389 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569d000640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56980c6e30 0x7f569813dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 -- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f569815ae80 msgr2=0x7f56980c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f569815ae80 0x7f56980c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 -- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56980c6e30 msgr2=0x7f569813dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56980c6e30 0x7f569813dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 -- 172.21.15.16:0/3273267438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5698157db0 con 0x7f569815eff0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569da00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5690009ee0 tx=0x7f569001bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56900b4040 con 0x7f569815eff0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f56900afcf0 con 0x7f569815eff0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56981f8e30 con 0x7f569815eff0 2024-04-25T11:06:22.390 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56900ba670 con 0x7f569815eff0 2024-04-25T11:06:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56980c1da0 con 0x7f569815eff0 2024-04-25T11:06:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.388+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56980c5e10 con 0x7f569815eff0 2024-04-25T11:06:22.391 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.392+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f56900c3020 con 0x7f569815eff0 2024-04-25T11:06:22.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.392+0000 7f5694c00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 0x7f5674071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:22.392 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.392+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6993+0+0 (secure 0 0 0) 0x7f569012dc00 con 0x7f569815eff0 2024-04-25T11:06:22.393 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.392+0000 7f569d000640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 0x7f5674071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:22.394 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.392+0000 7f569d000640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 0x7f5674071ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f568c001b50 tx=0x7f568c001ae0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:22.397 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.396+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5690134080 con 0x7f569815eff0 2024-04-25T11:06:22.564 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:22.564+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f56980c2740 con 0x7f569815eff0 2024-04-25T11:06:23.199 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.200+0000 7f5694c00640 1 -- 172.21.15.16:0/3273267438 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7f5698157db0 con 0x7f569815eff0 2024-04-25T11:06:23.199 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 msgr2=0x7f5674071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 0x7f5674071ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f568c001b50 tx=0x7f568c001ae0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 msgr2=0x7f56981f88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5690009ee0 tx=0x7f569001bf20 comp rx=0 tx=0).stop 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 shutdown_connections 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7f567406f5a0 0x7f5674071ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f569815eff0 0x7f56981f88f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.203 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f569815ae80 0x7f56980c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 --2- 172.21.15.16:0/3273267438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56980c6e30 0x7f569813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 >> 172.21.15.16:0/3273267438 conn(0x7f569806cc70 msgr2=0x7f5698158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:23.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 shutdown_connections 2024-04-25T11:06:23.204 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.204+0000 7f569fa00640 1 -- 172.21.15.16:0/3273267438 wait complete. 2024-04-25T11:06:23.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T11:06:23.417 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.416+0000 7fee81800640 1 Processor -- start 2024-04-25T11:06:23.418 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.416+0000 7fee81800640 1 -- start start 2024-04-25T11:06:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee81800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 0x7fee7c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee81800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0cd8f0 con 0x7fee7c0c5200 2024-04-25T11:06:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee81800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0cdbb0 con 0x7fee7c0c46e0 2024-04-25T11:06:23.419 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee81800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c0c8690 con 0x7fee7c0c8b20 2024-04-25T11:06:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7b400640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fee7c0c5200 0x7fee7c164720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46566/0 (socket says 172.21.15.16:46566) 2024-04-25T11:06:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7b400640 1 -- 172.21.15.16:0/1057848385 learned_addr learned my addr 172.21.15.16:0/1057848385 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7aa00640 1 --2- 172.21.15.16:0/1057848385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 0x7fee7c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:23.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee73e00640 1 --1- 172.21.15.16:0/1057848385 >> v1:172.21.15.186:6789/0 conn(0x7fee7c0c46e0 0x7fee7c0c4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.16:33090/0 (socket says 172.21.15.16:33090) 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841274351 0 0) 0x7fee7c0cd8f0 con 0x7fee7c0c5200 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee600035c0 con 0x7fee7c0c5200 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766138889 0 0) 0x7fee7c0cdbb0 con 0x7fee7c0c46e0 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee7c0cd8f0 con 0x7fee7c0c46e0 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7aa00640 1 -- 172.21.15.16:0/1057848385 >> v1:172.21.15.186:6789/0 conn(0x7fee7c0c46e0 legacy=0x7fee7c0c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7aa00640 1 -- 172.21.15.16:0/1057848385 >> v1:172.21.15.16:6789/0 conn(0x7fee7c0c5200 legacy=0x7fee7c164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.421 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.420+0000 7fee7aa00640 1 -- 172.21.15.16:0/1057848385 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0c7d60 con 0x7fee7c0c8b20 2024-04-25T11:06:23.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee7aa00640 1 --2- 172.21.15.16:0/1057848385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 0x7fee7c0c8f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fee7c159de0 tx=0x7fee6c01edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a47a1710051a9087 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0b5070 con 0x7fee7c0c8b20 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fee6c0a8ab0 con 0x7fee7c0c8b20 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee7a000640 1 -- 172.21.15.16:0/1057848385 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c0a8e60 con 0x7fee7c0c8b20 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 -- 172.21.15.16:0/1057848385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 msgr2=0x7fee7c0c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 --2- 172.21.15.16:0/1057848385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 0x7fee7c0c8f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fee7c159de0 tx=0x7fee6c01edb0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 -- 172.21.15.16:0/1057848385 shutdown_connections 2024-04-25T11:06:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 --2- 172.21.15.16:0/1057848385 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c8b20 0x7fee7c0c8f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 -- 172.21.15.16:0/1057848385 >> 172.21.15.16:0/1057848385 conn(0x7fee7c06cc70 msgr2=0x7fee7c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 -- 172.21.15.16:0/1057848385 shutdown_connections 2024-04-25T11:06:23.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 -- 172.21.15.16:0/1057848385 wait complete. 2024-04-25T11:06:23.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.424+0000 7fee81800640 1 Processor -- start 2024-04-25T11:06:23.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- start start 2024-04-25T11:06:23.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7c0c46e0 0x7fee7c1f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:23.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c5200 0x7fee7c154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:23.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c15ac40 con 0x7fee7c0c8b20 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c0c8320 con 0x7fee7c0c46e0 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c0c9470 con 0x7fee7c0c5200 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48238/0 (socket says 172.21.15.16:48238) 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 -- 172.21.15.16:0/483972666 learned_addr learned my addr 172.21.15.16:0/483972666 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee73e00640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c5200 0x7fee7c154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:23.429 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7aa00640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7c0c46e0 0x7fee7c1f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 -- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c5200 msgr2=0x7fee7c154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c5200 0x7fee7c154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 -- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7c0c46e0 msgr2=0x7fee7c1f07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7c0c46e0 0x7fee7c1f07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 -- 172.21.15.16:0/483972666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c154d80 con 0x7fee7c0c8b20 2024-04-25T11:06:23.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee7b400640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee74005c50 tx=0x7fee7400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7400aca0 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fee7400ae40 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74012640 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c1f6680 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.428+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c1f6c40 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c050750 con 0x7fee7c0c8b20 2024-04-25T11:06:23.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee740128a0 con 0x7fee7c0c8b20 2024-04-25T11:06:23.432 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee72a00640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 0x7fee54071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:23.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6555+0+0 (secure 0 0 0) 0x7fee7408fbd0 con 0x7fee7c0c8b20 2024-04-25T11:06:23.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee7aa00640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 0x7fee54071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:23.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.432+0000 7fee7aa00640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 0x7fee54071ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0b2000 tx=0x7fee6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:23.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.436+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee7405c0a0 con 0x7fee7c0c8b20 2024-04-25T11:06:23.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:23.604+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee7c154f90 con 0x7fee7c0c8b20 2024-04-25T11:06:24.201 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.200+0000 7fee72a00640 1 -- 172.21.15.16:0/483972666 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7fee740603a0 con 0x7fee7c0c8b20 2024-04-25T11:06:24.201 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2024-04-25T11:06:24.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 msgr2=0x7fee54071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 0x7fee54071ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0b2000 tx=0x7fee6c009040 comp rx=0 tx=0).stop 2024-04-25T11:06:24.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 msgr2=0x7fee7c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.205 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fee74005c50 tx=0x7fee7400a060 comp rx=0 tx=0).stop 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 shutdown_connections 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fee5406f5a0 0x7fee54071ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee7c0c8b20 0x7fee7c14e510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee7c0c5200 0x7fee7c154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 --2- 172.21.15.16:0/483972666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fee7c0c46e0 0x7fee7c1f07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 >> 172.21.15.16:0/483972666 conn(0x7fee7c06cc70 msgr2=0x7fee7c0cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 shutdown_connections 2024-04-25T11:06:24.207 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.204+0000 7fee81800640 1 -- 172.21.15.16:0/483972666 wait complete. 2024-04-25T11:06:24.243 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T11:06:24.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 Processor -- start 2024-04-25T11:06:24.423 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 -- start start 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe81415e120 0x7fe81406db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8140ca460 con 0x7fe8141540d0 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81415a210 con 0x7fe81406d780 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe81b800640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe81415d580 con 0x7fe81415e120 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe818e00640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe8141540d0 0x7fe8140c9d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:46582/0 (socket says 172.21.15.16:46582) 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe818e00640 1 -- 172.21.15.16:0/2168345430 learned_addr learned my addr 172.21.15.16:0/2168345430 (peer_addr_for_me v1:172.21.15.16:0/0) 2024-04-25T11:06:24.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe819800640 1 --2- 172.21.15.16:0/2168345430 >> v2:172.21.15.186:3300/0 conn(0x7fe81415e120 0x7fe81406db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283737370 0 0) 0x7fe808001330 con 0x7fe8141540d0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc0035c0 con 0x7fe8141540d0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1613305723 0 0) 0x7fe7fc0035c0 con 0x7fe8141540d0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 >> v2:172.21.15.186:3300/0 conn(0x7fe81415e120 msgr2=0x7fe81406db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 --2- 172.21.15.16:0/2168345430 >> v2:172.21.15.186:3300/0 conn(0x7fe81415e120 0x7fe81406db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 >> v1:172.21.15.186:6789/0 conn(0x7fe81406d780 legacy=0x7fe81415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81415a4d0 con 0x7fe8141540d0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 331138448 0 0) 0x7fe808001a60 con 0x7fe8141540d0 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 >> v1:172.21.15.16:6789/0 conn(0x7fe8141540d0 legacy=0x7fe8140c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc003a50 0x7fe7fc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.427 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7fc0048a0 0x7fe7fc004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 0x7fe7fc00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe81415d580 con 0x7fe7fc005240 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc00e3a0 con 0x7fe7fc003a50 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc00e5a0 con 0x7fe7fc0048a0 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe819800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 0x7fe7fc00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe813e00640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7fc0048a0 0x7fe7fc004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.424+0000 7fe818e00640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc003a50 0x7fe7fc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 -- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7fc0048a0 msgr2=0x7fe7fc004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe7fc0048a0 0x7fe7fc004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 -- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc003a50 msgr2=0x7fe7fc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc003a50 0x7fe7fc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 -- 172.21.15.16:0/2168345430 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc0035c0 con 0x7fe7fc005240 2024-04-25T11:06:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 -- 172.21.15.16:0/2168345430 reap_dead start 2024-04-25T11:06:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe819800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 0x7fe7fc00dc70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009fd0 tx=0x7fe80c01cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935933873d299e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0b2070 con 0x7fe7fc005240 2024-04-25T11:06:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe80c0a5d10 con 0x7fe7fc005240 2024-04-25T11:06:24.430 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.428+0000 7fe813400640 1 -- 172.21.15.16:0/2168345430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c009ca0 con 0x7fe7fc005240 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 msgr2=0x7fe7fc00dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 0x7fe7fc00dc70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009fd0 tx=0x7fe80c01cd00 comp rx=0 tx=0).stop 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- 172.21.15.16:0/2168345430 shutdown_connections 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 --2- 172.21.15.16:0/2168345430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7fc005240 0x7fe7fc00dc70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- 172.21.15.16:0/2168345430 >> 172.21.15.16:0/2168345430 conn(0x7fe8140cdb40 msgr2=0x7fe8140cdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- 172.21.15.16:0/2168345430 shutdown_connections 2024-04-25T11:06:24.431 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- 172.21.15.16:0/2168345430 wait complete. 2024-04-25T11:06:24.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 Processor -- start 2024-04-25T11:06:24.434 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.432+0000 7fe81b800640 1 -- start start 2024-04-25T11:06:24.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 0x7fe8141501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8141e7840 0x7fe81414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 -- 0x7fe81415ad70 con 0x7fe8141fc120 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe81415aad0 con 0x7fe7fc005240 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe8140b9b00 con 0x7fe8141e7840 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48252/0 (socket says 172.21.15.16:48252) 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 -- 172.21.15.16:0/3766830692 learned_addr learned my addr 172.21.15.16:0/3766830692 (peer_addr_for_me v2:172.21.15.16:0/0) 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe819800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8141e7840 0x7fe81414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe818e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 0x7fe8141501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 -- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8141e7840 msgr2=0x7fe81414d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8141e7840 0x7fe81414d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 -- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 msgr2=0x7fe8141501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:24.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 0x7fe8141501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 -- 172.21.15.16:0/3766830692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8141535c0 con 0x7fe8141fc120 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe818e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 0x7fe8141501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe813e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe80000f520 tx=0x7fe80000f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80001a070 con 0x7fe8141fc120 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe800005320 con 0x7fe8141fc120 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800007290 con 0x7fe8141fc120 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8140cd080 con 0x7fe8141fc120 2024-04-25T11:06:24.438 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8141e82f0 con 0x7fe8141fc120 2024-04-25T11:06:24.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe814050750 con 0x7fe8141fc120 2024-04-25T11:06:24.439 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.436+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe8000074f0 con 0x7fe8141fc120 2024-04-25T11:06:24.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.440+0000 7fe810c00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 0x7fe7f0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T11:06:24.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.440+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6025+0+0 (secure 0 0 0) 0x7fe80008eb20 con 0x7fe8141fc120 2024-04-25T11:06:24.440 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.440+0000 7fe818e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 0x7fe7f0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T11:06:24.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.440+0000 7fe818e00640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 0x7fe7f0071ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe8080014d0 tx=0x7fe808009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T11:06:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.444+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe80005b200 con 0x7fe8141fc120 2024-04-25T11:06:24.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:24.612+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe814147c80 con 0x7fe8141fc120 2024-04-25T11:06:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.220+0000 7fe810c00640 1 -- 172.21.15.16:0/3766830692 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7fe80005f500 con 0x7fe8141fc120 2024-04-25T11:06:25.221 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data_ec' removed 2024-04-25T11:06:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.224+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 msgr2=0x7fe7f0071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.224+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 0x7fe7f0071ae0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe8080014d0 tx=0x7fe808009040 comp rx=0 tx=0).stop 2024-04-25T11:06:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.224+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 msgr2=0x7fe8141506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T11:06:25.225 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.224+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe80000f520 tx=0x7fe80000f9e0 comp rx=0 tx=0).stop 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 shutdown_connections 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:6832/4166069756,v1:172.21.15.186:6833/4166069756] conn(0x7fe7f006f5d0 0x7fe7f0071ae0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8141e7840 0x7fe81414d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8141fc120 0x7fe8141506e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 --2- 172.21.15.16:0/3766830692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe7fc005240 0x7fe8141501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T11:06:25.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.228+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 >> 172.21.15.16:0/3766830692 conn(0x7fe8140cdb40 msgr2=0x7fe8141e8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T11:06:25.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.232+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 shutdown_connections 2024-04-25T11:06:25.250 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-25T11:06:25.248+0000 7fe81b800640 1 -- 172.21.15.16:0/3766830692 wait complete. 2024-04-25T11:06:25.335 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T11:06:25.336 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T11:06:25.336 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:25.339 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-25T11:06:25.340+0000 7f2579200640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i a (PID: 31304) UID: 0 2024-04-25T11:06:25.339 INFO:tasks.ceph.mds.a.smithi016.stderr:2024-04-25T11:06:25.340+0000 7f2579200640 -1 mds.a *** got signal Terminated *** 2024-04-25T11:06:30.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:06:30.410 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:06:31.438 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T11:06:31.439 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T11:06:31.439 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:31.440 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-25T11:06:31.440+0000 7fabeba00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i c (PID: 31306) UID: 0 2024-04-25T11:06:31.440 INFO:tasks.ceph.mds.c.smithi016.stderr:2024-04-25T11:06:31.440+0000 7fabeba00640 -1 mds.c *** got signal Terminated *** 2024-04-25T11:06:34.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-25T11:06:37.540 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T11:06:37.541 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T11:06:37.541 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:37.542 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-25T11:06:37.540+0000 7f1932a00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i e (PID: 31308) UID: 0 2024-04-25T11:06:37.542 INFO:tasks.ceph.mds.e.smithi016.stderr:2024-04-25T11:06:37.540+0000 7f1932a00640 -1 mds.e *** got signal Terminated *** 2024-04-25T11:06:40.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-04-25T11:06:40.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-25T11:06:43.643 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T11:06:43.644 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T11:06:43.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:43.645 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T11:06:43.646+0000 7fa1cc885640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i b (PID: 31986) UID: 0 2024-04-25T11:06:43.645 INFO:tasks.ceph.mds.b.smithi186.stderr:2024-04-25T11:06:43.646+0000 7fa1cc885640 -1 mds.b *** got signal Terminated *** 2024-04-25T11:06:47.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T11:06:47.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-04-25T11:06:49.746 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T11:06:49.746 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T11:06:49.746 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:49.747 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T11:06:49.749+0000 7febe9fad640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i d (PID: 31989) UID: 0 2024-04-25T11:06:49.747 INFO:tasks.ceph.mds.d.smithi186.stderr:2024-04-25T11:06:49.749+0000 7febe9fad640 -1 mds.d *** got signal Terminated *** 2024-04-25T11:06:53.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-25T11:06:53.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T11:06:55.847 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T11:06:55.848 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T11:06:55.848 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:06:55.849 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T11:06:55.849+0000 7ff950fd0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mds -f --cluster ceph -i f (PID: 31991) UID: 0 2024-04-25T11:06:55.849 INFO:tasks.ceph.mds.f.smithi186.stderr:2024-04-25T11:06:55.849+0000 7ff950fd0640 -1 mds.f *** got signal Terminated *** 2024-04-25T11:06:59.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-25T11:06:59.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-25T11:07:01.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:07:01.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:07:01.949 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T11:07:01.950 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T11:07:01.950 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T11:07:01.950 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:01.951 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T11:07:01.951+0000 7fb617c00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27572) UID: 0 2024-04-25T11:07:01.952 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T11:07:01.951+0000 7fb617c00640 -1 osd.0 38 *** Got signal Terminated *** 2024-04-25T11:07:01.952 INFO:tasks.ceph.osd.0.smithi016.stderr:2024-04-25T11:07:01.951+0000 7fb617c00640 -1 osd.0 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:06.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-25T11:07:06.123 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-25T11:07:08.051 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T11:07:08.052 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T11:07:08.052 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:08.053 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T11:07:08.051+0000 7fac63800640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27574) UID: 0 2024-04-25T11:07:08.053 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T11:07:08.051+0000 7fac63800640 -1 osd.1 40 *** Got signal Terminated *** 2024-04-25T11:07:08.053 INFO:tasks.ceph.osd.1.smithi016.stderr:2024-04-25T11:07:08.051+0000 7fac63800640 -1 osd.1 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:12.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T11:07:12.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-25T11:07:14.154 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T11:07:14.154 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T11:07:14.154 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:14.155 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T11:07:14.155+0000 7feb06600640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27576) UID: 0 2024-04-25T11:07:14.155 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T11:07:14.155+0000 7feb06600640 -1 osd.2 41 *** Got signal Terminated *** 2024-04-25T11:07:14.155 INFO:tasks.ceph.osd.2.smithi016.stderr:2024-04-25T11:07:14.155+0000 7feb06600640 -1 osd.2 41 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:18.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T11:07:18.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T11:07:20.255 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T11:07:20.256 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T11:07:20.256 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:20.257 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T11:07:20.255+0000 7f8bdf600640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27579) UID: 0 2024-04-25T11:07:20.257 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T11:07:20.255+0000 7f8bdf600640 -1 osd.3 42 *** Got signal Terminated *** 2024-04-25T11:07:20.257 INFO:tasks.ceph.osd.3.smithi016.stderr:2024-04-25T11:07:20.255+0000 7f8bdf600640 -1 osd.3 42 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:24.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T11:07:24.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T11:07:26.358 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T11:07:26.359 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T11:07:26.359 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:26.360 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T11:07:26.361+0000 7f498c36e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28299) UID: 0 2024-04-25T11:07:26.360 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T11:07:26.361+0000 7f498c36e640 -1 osd.4 43 *** Got signal Terminated *** 2024-04-25T11:07:26.360 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-04-25T11:07:26.361+0000 7f498c36e640 -1 osd.4 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:29.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-04-25T11:07:29.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T11:07:31.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:07:31.446 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:07:32.460 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T11:07:32.461 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T11:07:32.461 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:32.462 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T11:07:32.461+0000 7f1fdabf0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28301) UID: 0 2024-04-25T11:07:32.462 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T11:07:32.461+0000 7f1fdabf0640 -1 osd.5 44 *** Got signal Terminated *** 2024-04-25T11:07:32.462 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-04-25T11:07:32.461+0000 7f1fdabf0640 -1 osd.5 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:35.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-25T11:07:35.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-04-25T11:07:38.563 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T11:07:38.563 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T11:07:38.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:38.565 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T11:07:38.564+0000 7f8b440a1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28303) UID: 0 2024-04-25T11:07:38.565 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T11:07:38.564+0000 7f8b440a1640 -1 osd.6 45 *** Got signal Terminated *** 2024-04-25T11:07:38.565 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-04-25T11:07:38.564+0000 7f8b440a1640 -1 osd.6 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:41.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T11:07:41.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-25T11:07:44.666 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T11:07:44.666 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T11:07:44.666 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:44.668 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T11:07:44.668+0000 7f9dbcebb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28305) UID: 0 2024-04-25T11:07:44.668 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T11:07:44.668+0000 7f9dbcebb640 -1 osd.7 45 *** Got signal Terminated *** 2024-04-25T11:07:44.668 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-04-25T11:07:44.668+0000 7f9dbcebb640 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T11:07:46.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T11:07:46.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T11:07:50.768 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T11:07:50.768 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T11:07:50.769 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T11:07:50.769 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:50.826 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T11:07:50.827 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T11:07:50.827 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:50.861 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T11:07:50.861 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T11:07:50.862 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T11:07:50.862 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:50.863 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-25T11:07:50.863+0000 7fd891600640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i a (PID: 27467) UID: 0 2024-04-25T11:07:50.863 INFO:tasks.ceph.mon.a.smithi016.stderr:2024-04-25T11:07:50.863+0000 7fd891600640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T11:07:51.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T11:07:51.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T11:07:56.963 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T11:07:56.963 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T11:07:56.963 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:56.965 INFO:tasks.ceph.mon.b.smithi186.stderr:2024-04-25T11:07:56.964+0000 7f454c596640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i b (PID: 27975) UID: 0 2024-04-25T11:07:56.965 INFO:tasks.ceph.mon.b.smithi186.stderr:2024-04-25T11:07:56.964+0000 7f454c596640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-25T11:07:57.046 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T11:07:57.046 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T11:07:57.046 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T11:07:57.091 INFO:tasks.ceph.mon.c.smithi186.stderr:2024-04-25T11:07:57.092+0000 7f73b6490640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mon -f --cluster ceph -i c (PID: 27978) UID: 0 2024-04-25T11:07:57.091 INFO:tasks.ceph.mon.c.smithi186.stderr:2024-04-25T11:07:57.092+0000 7f73b6490640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-25T11:07:57.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T11:07:57.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T11:08:01.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:01.524 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:02.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T11:08:02.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T11:08:03.148 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T11:08:03.148 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T11:08:03.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T11:08:03.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:08:03.215 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T11:08:03.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:08:03.433 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T11:08:03.789 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:08:03.789 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T11:08:03.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:08:03.978 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T11:08:04.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T11:08:04.183 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T11:08:04.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T11:08:04.350 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T11:08:04.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T11:08:04.642 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T11:08:04.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T11:08:04.813 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T11:08:04.985 INFO:tasks.ceph:Archiving mon data... 2024-04-25T11:08:04.986 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/data/mon.a.tgz 2024-04-25T11:08:04.986 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-25T11:08:05.005 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.eCV0d5U01l 2024-04-25T11:08:05.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eCV0d5U01l 2024-04-25T11:08:05.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.eCV0d5U01l 2024-04-25T11:08:05.245 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.eCV0d5U01l is 371KB 2024-04-25T11:08:05.309 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.eCV0d5U01l 2024-04-25T11:08:05.317 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/data/mon.b.tgz 2024-04-25T11:08:05.318 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-25T11:08:05.353 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.hCU2YXVsZU 2024-04-25T11:08:05.353 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hCU2YXVsZU 2024-04-25T11:08:05.504 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.hCU2YXVsZU 2024-04-25T11:08:05.602 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.hCU2YXVsZU is 389KB 2024-04-25T11:08:05.664 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.hCU2YXVsZU 2024-04-25T11:08:05.671 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/data/mon.c.tgz 2024-04-25T11:08:05.671 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-25T11:08:05.719 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.mZlbn7uKam 2024-04-25T11:08:05.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mZlbn7uKam 2024-04-25T11:08:05.852 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.mZlbn7uKam 2024-04-25T11:08:05.915 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.mZlbn7uKam is 389KB 2024-04-25T11:08:05.933 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.mZlbn7uKam 2024-04-25T11:08:05.937 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T11:08:05.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T11:08:05.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T11:08:06.038 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T11:08:06.078 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T11:08:06.079 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T11:08:06.080 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi016/crash 2024-04-25T11:08:06.081 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T11:08:06.103 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi186/crash 2024-04-25T11:08:06.104 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T11:08:06.134 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T11:08:06.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:06.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:06.216 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:06.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T11:08:06.288 INFO:tasks.ceph:Compressing logs... 2024-04-25T11:08:06.288 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T11:08:06.291 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T11:08:06.320 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32344.log 2024-04-25T11:08:06.321 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32161.log 2024-04-25T11:08:06.322 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34485.log 2024-04-25T11:08:06.323 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32161.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32344.log.gz 2024-04-25T11:08:06.323 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-04-25T11:08:06.324 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35204.log 2024-04-25T11:08:06.324 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34485.log.gz 2024-04-25T11:08:06.325 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33507.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T11:08:06.325 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31583.log 2024-04-25T11:08:06.326 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35204.log.gz 2024-04-25T11:08:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31663.log 2024-04-25T11:08:06.327 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2024-04-25T11:08:06.328 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31583.log.gz 2024-04-25T11:08:06.328 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-04-25T11:08:06.328 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31663.log.gz 2024-04-25T11:08:06.329 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32051.log 2024-04-25T11:08:06.329 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2024-04-25T11:08:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32481.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32161.log.gz 2024-04-25T11:08:06.330 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32623.log 2024-04-25T11:08:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35429.log 2024-04-25T11:08:06.331 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32623.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T11:08:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35429.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-04-25T11:08:06.332 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33895.log 2024-04-25T11:08:06.332 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35429.log.gz 2024-04-25T11:08:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32649.log 2024-04-25T11:08:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-04-25T11:08:06.334 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34563.log 2024-04-25T11:08:06.335 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31313.log 2024-04-25T11:08:06.336 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33002.log 2024-04-25T11:08:06.336 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34563.log.gz 2024-04-25T11:08:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27693.log 2024-04-25T11:08:06.337 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33611.log 2024-04-25T11:08:06.338 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-04-25T11:08:06.339 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32213.log 2024-04-25T11:08:06.340 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34683.log 2024-04-25T11:08:06.341 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33715.log 2024-04-25T11:08:06.341 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-04-25T11:08:06.341 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34683.log.gz 2024-04-25T11:08:06.342 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-04-25T11:08:06.343 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-04-25T11:08:06.343 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31313.log.gz 2024-04-25T11:08:06.343 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-04-25T11:08:06.344 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2024-04-25T11:08:06.345 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34589.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T11:08:06.345 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-04-25T11:08:06.346 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-04-25T11:08:06.346 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2024-04-25T11:08:06.346 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32213.log.gz 2024-04-25T11:08:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27474.log 2024-04-25T11:08:06.347 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.33585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34459.log 2024-04-25T11:08:06.348 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-04-25T11:08:06.349 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-04-25T11:08:06.349 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34459.log.gz 2024-04-25T11:08:06.349 INFO:teuthology.orchestra.run.smithi016.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.27474.log.gz 2024-04-25T11:08:06.350 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34969.log 2024-04-25T11:08:06.350 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32727.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22667.log 2024-04-25T11:08:06.351 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2024-04-25T11:08:06.351 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34969.log.gz 2024-04-25T11:08:06.352 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.22667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32109.log 2024-04-25T11:08:06.352 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22667.log.gz 2024-04-25T11:08:06.353 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31717.log 2024-04-25T11:08:06.354 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35099.log 2024-04-25T11:08:06.354 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33637.log 2024-04-25T11:08:06.355 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35099.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T11:08:06.355 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35099.log.gz 2024-04-25T11:08:06.356 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33481.log 2024-04-25T11:08:06.357 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33403.log 2024-04-25T11:08:06.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35403.log 2024-04-25T11:08:06.359 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27693.log.gz 2024-04-25T11:08:06.359 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2024-04-25T11:08:06.359 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32109.log.gz 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31717.log.gz 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35403.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33481.log.gz 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33403.log.gz 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34511.log 2024-04-25T11:08:06.360 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35403.log.gz 2024-04-25T11:08:06.361 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32542.log 2024-04-25T11:08:06.362 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2024-04-25T11:08:06.362 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33202.log 2024-04-25T11:08:06.362 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34511.log.gz 2024-04-25T11:08:06.362 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2024-04-25T11:08:06.363 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34761.log 2024-04-25T11:08:06.364 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28193.log 2024-04-25T11:08:06.364 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28169.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35280.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33202.log.gz 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34761.log.gz 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33000.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32791.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35073.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34709.log 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T11:08:06.372 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33203.log 2024-04-25T11:08:06.373 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35073.log.gz 2024-04-25T11:08:06.373 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32370.log 2024-04-25T11:08:06.373 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-04-25T11:08:06.373 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31795.log 2024-04-25T11:08:06.373 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34787.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28193.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28169.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28241.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28145.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28121.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28217.log 2024-04-25T11:08:06.375 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28097.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28217.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28097.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28265.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.28265.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose/var/log/ceph/ceph.audit.log: -- /var/log/ceph/ceph-mds.b.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28193.log.gz 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28241.log.gz 2024-04-25T11:08:06.376 INFO:teuthology.orchestra.run.smithi186.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28169.log.gz 2024-04-25T11:08:06.377 INFO:teuthology.orchestra.run.smithi186.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28145.log.gz 2024-04-25T11:08:06.377 INFO:teuthology.orchestra.run.smithi186.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28217.log.gz 2024-04-25T11:08:06.378 INFO:teuthology.orchestra.run.smithi186.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28265.log.gz 2024-04-25T11:08:06.381 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31795.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T11:08:06.381 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32370.log.gz 2024-04-25T11:08:06.381 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33203.log.gz 2024-04-25T11:08:06.381 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34787.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33741.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33011.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33741.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33895.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31477.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.32051.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33741.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34839.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34537.log 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-04-25T11:08:06.382 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34839.log.gz 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32571.log 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31795.log.gz 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34537.log.gz 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33015.log 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32542.log.gz 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-04-25T11:08:06.383 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6%/var/log/ceph/ceph-client.admin.32571.log: -- replaced with /var/log/ceph/ceph-client.admin.32623.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31529.log 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31477.log.gz 2024-04-25T11:08:06.386 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33015.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35021.log 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32571.log.gz 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32239.log 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35151.log 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35021.log.gz 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35332.log 2024-04-25T11:08:06.387 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31923.log 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35151.log.gz 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33945.log 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35332.log.gz 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33429.log 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33945.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T11:08:06.389 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31529.log.gz 2024-04-25T11:08:06.390 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31769.log 2024-04-25T11:08:06.390 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33008.log 2024-04-25T11:08:06.391 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31769.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-04-25T11:08:06.391 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34943.log 2024-04-25T11:08:06.392 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33429.log.gz 2024-04-25T11:08:06.392 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31769.log.gz 2024-04-25T11:08:06.392 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31923.log.gz 2024-04-25T11:08:06.393 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31821.log 2024-04-25T11:08:06.393 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34891.log 2024-04-25T11:08:06.394 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34943.log.gz 2024-04-25T11:08:06.394 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31821.log: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T11:08:06.394 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31847.log 2024-04-25T11:08:06.395 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-04-25T11:08:06.396 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34891.log.gz 2024-04-25T11:08:06.396 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-04-25T11:08:06.397 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35455.log 2024-04-25T11:08:06.398 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-04-25T11:08:06.398 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33767.log 2024-04-25T11:08:06.399 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34123.log 2024-04-25T11:08:06.399 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35455.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31821.log.gz 2024-04-25T11:08:06.400 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33767.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35455.log.gz 2024-04-25T11:08:06.400 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-04-25T11:08:06.400 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31847.log.gz 2024-04-25T11:08:06.401 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.0.34123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35358.log 2024-04-25T11:08:06.401 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34123.log.gz 2024-04-25T11:08:06.401 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31423.log 2024-04-25T11:08:06.402 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-04-25T11:08:06.403 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35358.log.gz 2024-04-25T11:08:06.403 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31423.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33767.log.gz 2024-04-25T11:08:06.403 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32135.log 2024-04-25T11:08:06.404 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-04-25T11:08:06.404 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32292.log 2024-04-25T11:08:06.405 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32135.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T11:08:06.405 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32292.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T11:08:06.406 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32429.log 2024-04-25T11:08:06.406 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-04-25T11:08:06.407 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32429.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T11:08:06.408 INFO:teuthology.orchestra.run.smithi186.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz 2024-04-25T11:08:06.408 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-04-25T11:08:06.409 INFO:teuthology.orchestra.run.smithi016.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31423.log.gz 2024-04-25T11:08:06.409 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-04-25T11:08:06.409 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.32800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31451.log 2024-04-25T11:08:06.410 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-04-25T11:08:06.410 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32675.log 2024-04-25T11:08:06.411 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32795.log 2024-04-25T11:08:06.411 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33221.log 2024-04-25T11:08:06.412 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-04-25T11:08:06.413 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32135.log.gz 2024-04-25T11:08:06.413 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33221.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32292.log.gz 2024-04-25T11:08:06.413 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31611.log 2024-04-25T11:08:06.414 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-04-25T11:08:06.415 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35047.log 2024-04-25T11:08:06.415 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-04-25T11:08:06.416 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-04-25T11:08:06.417 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35047.log.gz 2024-04-25T11:08:06.417 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-04-25T11:08:06.418 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-04-25T11:08:06.418 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34995.log 2024-04-25T11:08:06.419 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32396.log 2024-04-25T11:08:06.419 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32701.log 2024-04-25T11:08:06.420 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34995.log.gz 2024-04-25T11:08:06.420 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-04-25T11:08:06.421 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-04-25T11:08:06.422 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35228.log 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33000.log.gz 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33002.log.gz 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33011.log.gz 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33008.log.gz 2024-04-25T11:08:06.423 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-04-25T11:08:06.424 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33015.log.gz 2024-04-25T11:08:06.424 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-04-25T11:08:06.424 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32429.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35228.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33611.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35178.log 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33637.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35228.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33715.log.gz 2024-04-25T11:08:06.425 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31873.log 2024-04-25T11:08:06.426 INFO:teuthology.orchestra.run.smithi016.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz 2024-04-25T11:08:06.426 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.35178.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33221.log.gz 2024-04-25T11:08:06.427 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2024-04-25T11:08:06.427 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33945.log.gz 2024-04-25T11:08:06.427 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35178.log.gz 2024-04-25T11:08:06.427 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34865.log 2024-04-25T11:08:06.428 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33819.log 2024-04-25T11:08:06.428 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31451.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31611.log.gz 2024-04-25T11:08:06.428 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-25T11:08:06.428 INFO:teuthology.orchestra.run.smithi016.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-04-25T11:08:06.429 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33211.log 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gz 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34865.log.gz -- replaced with /var/log/ceph/ceph-client.admin.32675.log.gz 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32701.log.gz 2024-04-25T11:08:06.430 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-04-25T11:08:06.431 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32795.log.gz 2024-04-25T11:08:06.431 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32396.log.gz 2024-04-25T11:08:06.432 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31397.log 2024-04-25T11:08:06.432 INFO:teuthology.orchestra.run.smithi016.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-04-25T11:08:06.432 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33211.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-04-25T11:08:06.432 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-04-25T11:08:06.433 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-04-25T11:08:06.433 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.31873.log.gz 2024-04-25T11:08:06.433 INFO:teuthology.orchestra.run.smithi016.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gz 2024-04-25T11:08:06.434 INFO:teuthology.orchestra.run.smithi016.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33819.log.gz 2024-04-25T11:08:06.434 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2024-04-25T11:08:06.434 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33211.log.gz 2024-04-25T11:08:06.435 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32187.log 2024-04-25T11:08:06.435 INFO:teuthology.orchestra.run.smithi016.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-04-25T11:08:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27583.log 2024-04-25T11:08:06.436 INFO:teuthology.orchestra.run.smithi016.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31397.log.gz 2024-04-25T11:08:06.436 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33010.log 2024-04-25T11:08:06.436 INFO:teuthology.orchestra.run.smithi016.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gz 2024-04-25T11:08:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.27583.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2024-04-25T11:08:06.437 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T11:08:06.438 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34917.log 2024-04-25T11:08:06.439 INFO:teuthology.orchestra.run.smithi016.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-04-25T11:08:06.439 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-mds.e.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-04-25T11:08:06.439 INFO:teuthology.orchestra.run.smithi016.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32187.log.gz 2024-04-25T11:08:06.440 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33010.log.gz 2024-04-25T11:08:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31743.log 2024-04-25T11:08:06.440 INFO:teuthology.orchestra.run.smithi016.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T11:08:06.440 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.34917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2024-04-25T11:08:06.440 INFO:teuthology.orchestra.run.smithi016.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34917.log.gz 2024-04-25T11:08:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33559.log 2024-04-25T11:08:06.441 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31277.log 2024-04-25T11:08:06.442 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.33559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-04-25T11:08:06.443 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.31277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-04-25T11:08:06.444 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph-client.admin.32991.log: /var/log/ceph/ceph-client.admin.33220.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31743.log.gz 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33559.log.gz 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31277.log.gz 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-04-25T11:08:06.446 INFO:teuthology.orchestra.run.smithi016.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2024-04-25T11:08:06.449 INFO:teuthology.orchestra.run.smithi016.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T11:08:06.507 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27583.log.gz 2024-04-25T11:08:06.533 INFO:teuthology.orchestra.run.smithi016.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-04-25T11:08:06.533 INFO:teuthology.orchestra.run.smithi016.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-04-25T11:08:06.533 INFO:teuthology.orchestra.run.smithi016.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-04-25T11:08:06.533 INFO:teuthology.orchestra.run.smithi016.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T11:08:06.553 INFO:teuthology.orchestra.run.smithi186.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T11:08:06.568 INFO:teuthology.orchestra.run.smithi186.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28097.log.gz 2024-04-25T11:08:06.599 INFO:teuthology.orchestra.run.smithi186.stderr: 93.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T11:08:07.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T11:08:08.695 INFO:teuthology.orchestra.run.smithi016.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T11:08:09.294 INFO:teuthology.orchestra.run.smithi186.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T11:08:09.366 INFO:teuthology.orchestra.run.smithi186.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T11:08:09.405 INFO:teuthology.orchestra.run.smithi016.stderr: 95.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T11:08:13.420 INFO:teuthology.orchestra.run.smithi186.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T11:08:37.589 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T11:08:43.935 INFO:teuthology.orchestra.run.smithi186.stderr: 95.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T11:08:56.145 INFO:teuthology.orchestra.run.smithi016.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T11:09:00.098 INFO:teuthology.orchestra.run.smithi186.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T11:09:17.330 INFO:teuthology.orchestra.run.smithi016.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T11:09:35.936 INFO:teuthology.orchestra.run.smithi016.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T11:09:43.128 INFO:teuthology.orchestra.run.smithi016.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T11:09:43.130 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-25T11:09:43.130 INFO:teuthology.orchestra.run.smithi016.stderr:real 1m36.835s 2024-04-25T11:09:43.130 INFO:teuthology.orchestra.run.smithi016.stderr:user 4m2.129s 2024-04-25T11:09:43.130 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m17.875s 2024-04-25T11:15:15.996 INFO:teuthology.orchestra.run.smithi186.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T11:16:12.223 INFO:teuthology.orchestra.run.smithi186.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T11:16:32.587 INFO:teuthology.orchestra.run.smithi186.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T11:16:43.449 INFO:teuthology.orchestra.run.smithi186.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T11:16:43.450 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-04-25T11:16:43.450 INFO:teuthology.orchestra.run.smithi186.stderr:real 8m37.117s 2024-04-25T11:16:43.450 INFO:teuthology.orchestra.run.smithi186.stderr:user 9m37.292s 2024-04-25T11:16:43.450 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m23.471s 2024-04-25T11:16:43.452 INFO:tasks.ceph:Archiving logs... 2024-04-25T11:16:43.453 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi016/log 2024-04-25T11:16:43.454 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T11:17:17.691 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi186/log 2024-04-25T11:17:17.693 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T11:18:46.179 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T11:18:46.188 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T11:18:46.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T11:18:46.193 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T11:18:46.304 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T11:18:46.313 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T11:18:46.313 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:18:46.316 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T11:18:46.369 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T11:18:46.369 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2024-04-25T11:18:46.369 INFO:teuthology.orchestra.run.smithi016.stdout:+hv01.front.sepi 67.205.162.81 3 u 4 128 377 0.112 -3.007 0.634 2024-04-25T11:18:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 63.231.80.2 3 u 70 128 377 0.077 -1.654 0.629 2024-04-25T11:18:46.370 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 78 128 377 0.094 -1.147 0.764 2024-04-25T11:18:46.370 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================== 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout:+hv01.front.sepi 67.205.162.81 3 u 88 128 377 0.078 -4.287 0.434 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout:*hv02.front.sepi 63.231.80.2 3 u 59 128 377 0.087 -2.707 0.425 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout:+hv03.front.sepi 74.6.168.72 3 u 76 128 377 0.104 -2.315 0.459 2024-04-25T11:18:46.439 INFO:teuthology.orchestra.run.smithi186.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-25T11:18:46.440 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T11:18:46.449 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T11:18:46.450 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T11:18:46.507 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T11:18:46.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T11:18:46.524 INFO:teuthology.task.internal:Duration was 3105.240522 seconds 2024-04-25T11:18:46.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T11:18:46.534 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T11:18:46.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T11:18:46.537 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T11:18:46.767 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T11:18:46.767 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-25T11:18:46.768 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T11:18:46.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T11:18:46.791 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T11:18:46.807 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T11:18:46.807 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T11:18:46.840 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T11:18:46.886 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T11:18:46.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T11:18:46.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T11:18:47.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T11:18:47.169 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T11:18:47.169 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T11:18:47.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T11:18:47.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T11:18:47.261 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:18:47.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:18:47.288 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-25T11:18:47.316 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-04-25T11:18:47.356 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:18:47.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:18:47.376 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T11:18:47.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T11:18:47.406 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T11:18:47.416 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T11:18:47.417 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi016 2024-04-25T11:18:47.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T11:18:47.446 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673075/remote/smithi186 2024-04-25T11:18:47.447 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T11:18:47.468 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T11:18:47.469 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T11:18:47.492 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T11:18:47.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T11:18:47.524 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T11:18:47.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T11:18:47.534 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T11:18:47.534 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T11:18:47.544 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T11:18:47.549 INFO:teuthology.orchestra.run.smithi016.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 11:18 /home/ubuntu/cephtest 2024-04-25T11:18:47.561 INFO:teuthology.orchestra.run.smithi186.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 11:18 /home/ubuntu/cephtest 2024-04-25T11:18:47.562 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T11:18:47.573 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T11:18:47.597 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/3 tasks/dbench validater/lockdep} duration: 3105.2405219078064 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T11:18:47.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T11:18:47.681 INFO:teuthology.run:pass